Apr 20 13:15:26 user devstack@n-api.service[61276]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 20 13:15:26 user devstack@n-api.service[61276]: *** Starting uWSGI 2.0.20-debian (64bit) on [Thu Apr 20 13:15:26 2023] *** Apr 20 13:15:26 user devstack@n-api.service[61276]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 20 13:15:26 user devstack@n-api.service[61276]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 20 13:15:26 user devstack@n-api.service[61276]: nodename: user Apr 20 13:15:26 user devstack@n-api.service[61276]: machine: x86_64 Apr 20 13:15:26 user devstack@n-api.service[61276]: clock source: unix Apr 20 13:15:26 user devstack@n-api.service[61276]: pcre jit disabled Apr 20 13:15:26 user devstack@n-api.service[61276]: detected number of CPU cores: 12 Apr 20 13:15:26 user devstack@n-api.service[61276]: current working directory: / Apr 20 13:15:26 user devstack@n-api.service[61276]: detected binary path: /usr/bin/uwsgi-core Apr 20 13:15:26 user devstack@n-api.service[61276]: your processes number limit is 63637 Apr 20 13:15:26 user devstack@n-api.service[61276]: your memory page size is 4096 bytes Apr 20 13:15:26 user devstack@n-api.service[61276]: detected max file descriptor number: 2048 Apr 20 13:15:26 user devstack@n-api.service[61276]: lock engine: pthread robust mutexes Apr 20 13:15:26 user devstack@n-api.service[61276]: thunder lock: enabled Apr 20 13:15:26 user devstack@n-api.service[61276]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 20 13:15:26 user devstack@n-api.service[61276]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 20 13:15:26 user devstack@n-api.service[61276]: Python main interpreter initialized at 0x556332fcd990 Apr 20 13:15:26 user devstack@n-api.service[61276]: python threads support enabled Apr 20 13:15:26 user devstack@n-api.service[61276]: your server socket listen backlog is limited to 100 connections Apr 20 13:15:26 user devstack@n-api.service[61276]: your mercy for graceful operations on workers is 90 seconds Apr 20 13:15:26 user devstack@n-api.service[61276]: mapped 537436 bytes (524 KB) for 3 cores Apr 20 13:15:26 user devstack@n-api.service[61276]: *** Operational MODE: preforking *** Apr 20 13:15:26 user devstack@n-api.service[61276]: *** uWSGI is running in multiple interpreter mode *** Apr 20 13:15:26 user devstack@n-api.service[61276]: spawned uWSGI master process (pid: 61276) Apr 20 13:15:26 user devstack@n-api.service[61276]: spawned uWSGI worker 1 (pid: 61277, cores: 1) Apr 20 13:15:26 user devstack@n-api.service[61276]: spawned uWSGI worker 2 (pid: 61278, cores: 1) Apr 20 13:15:26 user devstack@n-api.service[61276]: spawned uWSGI worker 3 (pid: 61279, cores: 1) Apr 20 13:15:26 user devstack@n-api.service[61276]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 20 13:15:27 user devstack@n-api.service[61278]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 13:15:27 user devstack@n-api.service[61277]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 13:15:27 user devstack@n-api.service[61279]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 13:15:30 user devstack@n-api.service[61277]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 13:15:30 user devstack@n-api.service[61277]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 13:15:30 user devstack@n-api.service[61277]: and ``live_migration_inbound_addr`` respectively. Apr 20 13:15:30 user devstack@n-api.service[61277]: ). Its value may be silently ignored in the future. Apr 20 13:15:30 user devstack@n-api.service[61279]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 13:15:30 user devstack@n-api.service[61279]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 13:15:30 user devstack@n-api.service[61279]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 13:15:30 user devstack@n-api.service[61279]: and ``live_migration_inbound_addr`` respectively. Apr 20 13:15:30 user devstack@n-api.service[61279]: ). Its value may be silently ignored in the future. Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 20 13:15:30 user devstack@n-api.service[61278]: live_migration_uri is deprecated for removal in favor of two other options that Apr 20 13:15:30 user devstack@n-api.service[61278]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 20 13:15:30 user devstack@n-api.service[61278]: and ``live_migration_inbound_addr`` respectively. Apr 20 13:15:30 user devstack@n-api.service[61278]: ). Its value may be silently ignored in the future. Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61279) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61277) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61278) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 20 13:15:31 user devstack@n-api.service[61277]: INFO dbcounter [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Registered counter for database nova_api Apr 20 13:15:31 user devstack@n-api.service[61279]: INFO dbcounter [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Registered counter for database nova_api Apr 20 13:15:31 user devstack@n-api.service[61278]: INFO dbcounter [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Registered counter for database nova_api Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_db.sqlalchemy.engines [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61279) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_db.sqlalchemy.engines [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61277) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writer thread running {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writer thread running {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_db.sqlalchemy.engines [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61278) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writer thread running {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG nova.context [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6d068e-9cbf-4ca5-a5c2-9826745af97f(cell1) {{(pid=61279) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG nova.context [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6d068e-9cbf-4ca5-a5c2-9826745af97f(cell1) {{(pid=61277) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61279]: INFO dbcounter [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG nova.context [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),db6d068e-9cbf-4ca5-a5c2-9826745af97f(cell1) {{(pid=61278) load_cells /opt/stack/nova/nova/context.py:464}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61279]: INFO dbcounter [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Registered counter for database nova_cell1 Apr 20 13:15:31 user devstack@n-api.service[61277]: INFO dbcounter [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61277]: INFO dbcounter [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Registered counter for database nova_cell1 Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_db.sqlalchemy.engines [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61279) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_db.sqlalchemy.engines [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61279) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:15:31 user devstack@n-api.service[61278]: INFO dbcounter [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writer thread running {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writer thread running {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61278]: INFO dbcounter [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Registered counter for database nova_cell1 Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_db.sqlalchemy.engines [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61277) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writer thread running {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_db.sqlalchemy.engines [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61277) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_db.sqlalchemy.engines [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61278) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writer thread running {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_db.sqlalchemy.engines [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61278) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61279]: INFO dbcounter [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writer thread running {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61277]: INFO dbcounter [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG oslo_db.sqlalchemy.engines [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61279) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writer thread running {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG oslo_db.sqlalchemy.engines [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61277) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writer thread running {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writer thread running {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61278]: INFO dbcounter [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Registered counter for database nova_cell0 Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG oslo_db.sqlalchemy.engines [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61278) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 20 13:15:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writer thread running {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 20 13:15:31 user devstack@n-api.service[61277]: WARNING keystonemiddleware.auth_token [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61279]: WARNING keystonemiddleware.auth_token [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61277]: WARNING keystonemiddleware.auth_token [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61279]: WARNING keystonemiddleware.auth_token [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61278]: WARNING keystonemiddleware.auth_token [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61278]: WARNING keystonemiddleware.auth_token [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61277]: WARNING keystonemiddleware.auth_token [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61277]: WARNING keystonemiddleware.auth_token [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61278]: WARNING keystonemiddleware.auth_token [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61279]: WARNING keystonemiddleware.auth_token [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 20 13:15:31 user devstack@n-api.service[61277]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556332fcd990 pid: 61277 (default app) Apr 20 13:15:31 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:15:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001488 Apr 20 13:15:31 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Thu Apr 20 13:15:31 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:15:31 user devstack@n-api.service[61278]: WARNING keystonemiddleware.auth_token [None req-f685bfda-abea-4237-a48b-d87b26b1d003 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61279]: WARNING keystonemiddleware.auth_token [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 20 13:15:31 user devstack@n-api.service[61278]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556332fcd990 pid: 61278 (default app) Apr 20 13:15:31 user devstack@n-api.service[61279]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556332fcd990 pid: 61279 (default app) Apr 20 13:17:39 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:39 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-31a7f85b-9dc7-4859-a880-c8d61f1871f6 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001388 Apr 20 13:17:39 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:39 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:39 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:39 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:39 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:39 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:39 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-e601317e-e273-4d35-98c2-8a9e7db9843b admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:40 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-e601317e-e273-4d35-98c2-8a9e7db9843b admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.420452 Apr 20 13:17:40 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 13:17:39 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:42 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:42 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002914 Apr 20 13:17:42 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:42 2023] GET /compute/v2.1 => generated 387 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:42 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:42 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:42 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:42 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:42 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-1ce90a1e-328f-4317-b6e8-55108a5334d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "id": "c1"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:42 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-1ce90a1e-328f-4317-b6e8-55108a5334d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.331409 Apr 20 13:17:42 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:42 2023] POST /compute/v2.1/flavors => generated 405 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-748881b0-dccd-4945-918d-c74108ae9237 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-748881b0-dccd-4945-918d-c74108ae9237 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057355 Apr 20 13:17:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 13:17:42 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:44 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:44 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001304 Apr 20 13:17:44 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-21238550-4ea6-4c13-9a6f-62844c1a51b8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "swap": 0, "name": "ds512M", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-21238550-4ea6-4c13-9a6f-62844c1a51b8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.058582 Apr 20 13:17:44 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:44 2023] POST /compute/v2.1/flavors => generated 402 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-27a491ef-4e89-4781-90fb-a6f4b28808b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-27a491ef-4e89-4781-90fb-a6f4b28808b8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028548 Apr 20 13:17:44 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 13:17:44 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:46 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001213 Apr 20 13:17:46 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:46 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:46 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-fde7e29f-539c-497b-b95c-bc822c61ac98 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d2", "vcpus": 1, "os-flavor-access:is_public": true, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-fde7e29f-539c-497b-b95c-bc822c61ac98 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073507 Apr 20 13:17:46 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:46 2023] POST /compute/v2.1/flavors => generated 402 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:46 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-831fe091-e7a0-4444-8167-7a65db4b8c51 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:46 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-831fe091-e7a0-4444-8167-7a65db4b8c51 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032037 Apr 20 13:17:46 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 13:17:46 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001262 Apr 20 13:17:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:48 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-dc7f987b-d353-444d-b796-e38334b64b61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:48 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-dc7f987b-d353-444d-b796-e38334b64b61 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.056081 Apr 20 13:17:48 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:48 2023] POST /compute/v2.1/flavors => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:48 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-aac5f693-f996-4a2d-9c75-cad39ff74a4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-aac5f693-f996-4a2d-9c75-cad39ff74a4c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024316 Apr 20 13:17:48 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 13:17:48 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001260 Apr 20 13:17:50 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:50 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:50 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-fed08e23-7025-4b8b-ae1c-3aa61e6d3747 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:50 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-fed08e23-7025-4b8b-ae1c-3aa61e6d3747 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.055205 Apr 20 13:17:50 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:50 2023] POST /compute/v2.1/flavors => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:50 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:50 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025190 Apr 20 13:17:50 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Thu Apr 20 13:17:50 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:52 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:52 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a3ca3dd3-ad96-4197-b865-0765de461865 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001265 Apr 20 13:17:52 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:52 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:52 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a63e4225-5fb1-45f1-bc0c-43a13bb6d5a3 admin admin] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-a63e4225-5fb1-45f1-bc0c-43a13bb6d5a3 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070064 Apr 20 13:17:52 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Thu Apr 20 13:17:52 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:17:54 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:54 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001508 Apr 20 13:17:54 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:54 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:54 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:54 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:54 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:54 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:17:54 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0d707b6d-57c8-49cb-9eb4-a876f14f9556 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "ram": 512, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:54 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-0d707b6d-57c8-49cb-9eb4-a876f14f9556 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.314987 Apr 20 13:17:54 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:54 2023] POST /compute/v2.1/flavors => generated 400 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:54 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-fbf602a4-0833-4e19-8c7b-ae24f34b8bed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:54 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-fbf602a4-0833-4e19-8c7b-ae24f34b8bed admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037393 Apr 20 13:17:54 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 13:17:54 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 13:17:56 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:56 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002325 Apr 20 13:17:56 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:56 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:56 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-860c0573-ae8a-4511-b274-b17b0693862f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "name": "m1.small", "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:56 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-860c0573-ae8a-4511-b274-b17b0693862f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.060761 Apr 20 13:17:56 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:56 2023] POST /compute/v2.1/flavors => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 20 13:17:56 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-b9511802-9903-4f6e-a4dd-b116d6b22aba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-b9511802-9903-4f6e-a4dd-b116d6b22aba admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028342 Apr 20 13:17:56 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 13:17:56 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:17:58 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:17:58 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002219 Apr 20 13:17:58 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:17:58 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:17:58 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-1a8cd343-d88b-4ea2-ab80-9c713a1bb1b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "id": "3", "disk": 40, "name": "m1.medium", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-1a8cd343-d88b-4ea2-ab80-9c713a1bb1b0 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067036 Apr 20 13:17:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:17:58 2023] POST /compute/v2.1/flavors => generated 404 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:17:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-791c10bb-e0a6-475c-a4ae-989c9587fdab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:17:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-791c10bb-e0a6-475c-a4ae-989c9587fdab admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024746 Apr 20 13:17:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 13:17:58 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:18:00 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:18:00 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001429 Apr 20 13:18:00 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:18:00 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:18:00 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-5f5aa1fe-a7e0-41c9-b302-8ec529153ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "id": "4", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.large", "ram": 8192}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:18:00 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-5f5aa1fe-a7e0-41c9-b302-8ec529153ba3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067018 Apr 20 13:18:00 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:18:00 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:18:00 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-69222011-fdb8-484b-a263-c24f72446233 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:18:00 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-69222011-fdb8-484b-a263-c24f72446233 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024754 Apr 20 13:18:00 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 13:18:00 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:18:02 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:18:02 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001403 Apr 20 13:18:02 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Thu Apr 20 13:18:02 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:18:02 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-fde2e035-f36e-46c0-8f56-b364c12207f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "disk": 160, "name": "m1.xlarge", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "ram": 16384}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:18:02 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-fde2e035-f36e-46c0-8f56-b364c12207f8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.064427 Apr 20 13:18:02 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Thu Apr 20 13:18:02 2023] POST /compute/v2.1/flavors => generated 406 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:18:02 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-12fd9fe3-3e38-4ec0-8f28-bca34adff7d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:18:02 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-12fd9fe3-3e38-4ec0-8f28-bca34adff7d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029416 Apr 20 13:18:02 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Thu Apr 20 13:18:02 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:18:33 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:18:33 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4eb5876d-ebfe-41d9-b64c-672625d15a41 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001368 Apr 20 13:18:33 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 13:18:33 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:18:33 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:18:33 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.098445 Apr 20 13:18:33 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Thu Apr 20 13:18:33 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:19:05 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-12fd9fe3-3e38-4ec0-8f28-bca34adff7d5 admin admin] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:19:05 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-12fd9fe3-3e38-4ec0-8f28-bca34adff7d5 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001492 Apr 20 13:19:05 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 13:19:05 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:19:05 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:19:05 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-78710ef4-695e-4176-bedd-77f4e44e12fc admin admin] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:19:05 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-78710ef4-695e-4176-bedd-77f4e44e12fc admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.068417 Apr 20 13:19:05 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Thu Apr 20 13:19:05 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:19:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:19:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001593 Apr 20 13:19:09 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 13:19:09 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:19:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:19:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-57bc43b9-6d80-4909-817c-7c1852a32df8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 128, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "id": "42", "name": "m1.nano"}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:19:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-57bc43b9-6d80-4909-817c-7c1852a32df8 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.066557 Apr 20 13:19:09 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 13:19:09 2023] POST /compute/v2.1/flavors => generated 403 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:19:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-06f51008-97a8-43c1-adc6-67bd421f0125 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:19:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-06f51008-97a8-43c1-adc6-67bd421f0125 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029447 Apr 20 13:19:09 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 13:19:09 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:19:13 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:19:13 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-95a67f4a-a2ef-4938-87fb-b847a6046b2c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001287 Apr 20 13:19:13 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Thu Apr 20 13:19:13 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:19:13 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-2cecf04a-0ae9-4513-b08c-f4f99b136cb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "84", "disk": 1, "os-flavor-access:is_public": true, "name": "m1.micro", "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:19:13 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-2cecf04a-0ae9-4513-b08c-f4f99b136cb6 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.061421 Apr 20 13:19:13 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Thu Apr 20 13:19:13 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:19:13 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c367c159-9077-4e98-9b95-a2c3c7f940bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:19:13 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-c367c159-9077-4e98-9b95-a2c3c7f940bd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025882 Apr 20 13:19:13 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Thu Apr 20 13:19:13 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:41 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:21:41 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:21:41 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:21:42 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-613087333", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:42 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] validate_networks() for [('45b1a915-83c9-43cb-b08f-ce8ffa157e75', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Getting quotas for project 4a526e5a9ffe4ec6a153bb0bc218913e. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Getting quotas for user c7e63be0504a4fcca19c8b86d95c699d and project 4a526e5a9ffe4ec6a153bb0bc218913e. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:21:43 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:21:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-070317e6-9508-41d4-986d-217dc0739839 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.767293 Apr 20 13:21:43 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:21:41 2023] POST /compute/v2.1/servers => generated 381 bytes in 1769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:21:43 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:21:43 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-e44024ac-ab6a-441a-9e5b-31d77258b8f4 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:21:43 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-e44024ac-ab6a-441a-9e5b-31d77258b8f4 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:21:44 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-e44024ac-ab6a-441a-9e5b-31d77258b8f4 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:21:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-e44024ac-ab6a-441a-9e5b-31d77258b8f4 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968" status: 200 len: 1215 microversion: 2.1 time: 0.448039 Apr 20 13:21:44 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:21:43 2023] GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 => generated 1215 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:44 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:21:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1890937775", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:44 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] validate_networks() for [('45b1a915-83c9-43cb-b08f-ce8ffa157e75', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Getting quotas for project 4a526e5a9ffe4ec6a153bb0bc218913e. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Getting quotas for user c7e63be0504a4fcca19c8b86d95c699d and project 4a526e5a9ffe4ec6a153bb0bc218913e. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:21:46 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:21:46 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-98556f2c-6d6e-43bd-97e3-f7ad9ce41bd6 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.596221 Apr 20 13:21:46 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 16/48] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:21:44 2023] POST /compute/v2.1/servers => generated 381 bytes in 2598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:21:46 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-2e2d4953-d7e5-480a-a53d-dbe4365cd395 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:21:46 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-2e2d4953-d7e5-480a-a53d-dbe4365cd395 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:21:47 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-2e2d4953-d7e5-480a-a53d-dbe4365cd395 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:21:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-2e2d4953-d7e5-480a-a53d-dbe4365cd395 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 200 len: 1216 microversion: 2.1 time: 0.374860 Apr 20 13:21:47 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:21:46 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 1216 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:47 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-596b329d-4d4c-413a-95f2-103b9671ee2e tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Action: 'create', calling method: .version_select at 0x7f31d9d0e950>, body: {"keypair": {"name": "tempest-keypair-1028024611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAvgrUDVs2bYxuFMiOWqowKsnyI1V+hkrrf5ir88dnej7w5r9TztMJnSVUpy7LNCrzmN+XYJGWXoyqrEELXEe2fsPemjFOY5xABjXL2/O6xEajeC3U36oyUzPsIEB1uCog=="}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:47 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-596b329d-4d4c-413a-95f2-103b9671ee2e tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Getting quotas for project 5d5d76af78b94668a18adcddc22a8440. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:47 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-596b329d-4d4c-413a-95f2-103b9671ee2e tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Getting quotas for user 882cab9c92ed4bfa8682a25169a49d9b and project 5d5d76af78b94668a18adcddc22a8440. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:47 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-596b329d-4d4c-413a-95f2-103b9671ee2e tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.374651 Apr 20 13:21:47 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 18/50] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:21:47 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:21:47 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-90cfc18b-15bb-427f-abe9-5d2d0db045ab tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Action: 'create', calling method: .version_select at 0x7f31d9d88820>, body: {"keypair": {"name": "tempest-keypair-549168830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCqrIeqey7FCIBG2PNerJ7RwNhi26VprsJIrKDP5QSx3+XMQ18xuWP5Im90DbHZBZH80+DweeEBh0htvNj7JlXdD9wqtghUeGNbOJDlYiGRKUQLw/T4e1iDlVvg46ssNQ=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:47 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-90cfc18b-15bb-427f-abe9-5d2d0db045ab tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Getting quotas for project 332b3979ef1244e1aff870bbc27a9817. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:47 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-90cfc18b-15bb-427f-abe9-5d2d0db045ab tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Getting quotas for user badaaf29beb14beeb94db96f7bc995b0 and project 332b3979ef1244e1aff870bbc27a9817. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:47 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-90cfc18b-15bb-427f-abe9-5d2d0db045ab tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241192 Apr 20 13:21:47 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:21:47 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:21:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-29209281", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "bd94b0ee-bbfd-4ec6-9153-087f0c06f061"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:50 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] validate_networks() for [('bd94b0ee-bbfd-4ec6-9153-087f0c06f061', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Creating event network-changed:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61277) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0db9fce0-fa97-45e4-a4e0-7ad4eb35b76b req-ed5e47aa-9166-4770-b6c3-971bba53b1e9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61277) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61277]: INFO nova.compute.rpcapi [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 13:21:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] Releasing lock "compute-rpcapi-router" {{(pid=61277) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 13:21:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f1d98d13-142e-4379-a63b-c14d37a01bab None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135730 Apr 20 13:21:52 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 19/52] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Creating event network-changed:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61278) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-86606c1a-bf20-4a7d-afd1-9d60b91fab82 req-7793732f-8c55-4ed6-8e7b-0cdf82ad9ea6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61278) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61278]: INFO nova.compute.rpcapi [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 13:21:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] Releasing lock "compute-rpcapi-router" {{(pid=61278) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 13:21:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-ce796329-413b-4110-a5e5-17850a3321cf None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162562 Apr 20 13:21:52 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 18/53] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:21:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Getting quotas for project eb01d14674514d6c8224cee3d42b8750. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Getting quotas for user 2a150206963a4369b2cab6a71c9188e1 and project eb01d14674514d6c8224cee3d42b8750. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:52 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:21:53 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:21:53 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-ebdedee2-d64e-4333-9a46-c1c8eb16d177 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.442713 Apr 20 13:21:53 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 17/54] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:21:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 2445 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:21:53 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ef0b6a2e-3af8-4d22-9bcc-ce72757683b7 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:21:53 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-ef0b6a2e-3af8-4d22-9bcc-ce72757683b7 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:21:53 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-ef0b6a2e-3af8-4d22-9bcc-ce72757683b7 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a150206963a4369b2cab6a71c9188e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb01d14674514d6c8224cee3d42b8750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:21:53 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ef0b6a2e-3af8-4d22-9bcc-ce72757683b7 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590" status: 200 len: 1207 microversion: 2.1 time: 0.236354 Apr 20 13:21:53 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 20/55] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:21:53 2023] GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 => generated 1207 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:54 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-277007948", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "9490551d-c70d-4a05-8097-81d1b4cd7325"}], "security_groups": [{"name": "tempest-securitygroup--1787344114"}], "key_name": "tempest-keypair-549168830", "user_data": "}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:54 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] validate_networks() for [('9490551d-c70d-4a05-8097-81d1b4cd7325', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:21:55 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-2015992479", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "178edd74-64db-4ad6-af43-147f3224a59f"}], "security_groups": [{"name": "tempest-securitygroup--455896924"}], "key_name": "tempest-keypair-1028024611", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:55 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] validate_networks() for [('178edd74-64db-4ad6-af43-147f3224a59f', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Getting quotas for project 332b3979ef1244e1aff870bbc27a9817. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Getting quotas for user badaaf29beb14beeb94db96f7bc995b0 and project 332b3979ef1244e1aff870bbc27a9817. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:21:56 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:21:56 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-e1dd0c86-4915-4308-b1cd-b17b68e59d9a tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 2.562157 Apr 20 13:21:56 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 19/56] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:21:54 2023] POST /compute/v2.1/servers => generated 407 bytes in 2564 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:21:56 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-3de0ed78-6297-4180-b6e1-1123adb7eb60 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:21:56 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-3de0ed78-6297-4180-b6e1-1123adb7eb60 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:21:56 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-3de0ed78-6297-4180-b6e1-1123adb7eb60 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:21:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-3de0ed78-6297-4180-b6e1-1123adb7eb60 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1231 microversion: 2.1 time: 0.118134 Apr 20 13:21:56 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 21/57] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:21:56 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1231 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Getting quotas for project 5d5d76af78b94668a18adcddc22a8440. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Getting quotas for user 882cab9c92ed4bfa8682a25169a49d9b and project 5d5d76af78b94668a18adcddc22a8440. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:21:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:21:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-4fc9caa2-5ad5-42b5-9ebd-c357cdf51d11 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.682957 Apr 20 13:21:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 18/58] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:21:55 2023] POST /compute/v2.1/servers => generated 403 bytes in 2684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:21:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-625c8e56-ad01-463a-bced-68aace2b048b tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:21:58 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-625c8e56-ad01-463a-bced-68aace2b048b tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:21:58 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-625c8e56-ad01-463a-bced-68aace2b048b tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882cab9c92ed4bfa8682a25169a49d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5d76af78b94668a18adcddc22a8440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:21:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-625c8e56-ad01-463a-bced-68aace2b048b tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 200 len: 1240 microversion: 2.1 time: 0.094926 Apr 20 13:21:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 22/59] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:21:58 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 1240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:21:58 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-7a989fcc-f2d0-4c2f-9a2a-ef88e6ba15a6 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Action: 'create', calling method: .version_select at 0x7f31d940d630>, body: {"keypair": {"name": "tempest-keypair-18511535", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO0SwR41S4I6ZFIvw/2fyt4LYDCe23p3LAU+tQkt+gxHRj9qpCCoGEMMVqPgm+KlN+3Vn3fb3o8QISZm+QnUUS92/Yhj2oO9+E/YGSG79JTb2arEaJgmgNtfhvC0j4flwQ=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:58 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-7a989fcc-f2d0-4c2f-9a2a-ef88e6ba15a6 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for project 973f328b0e474229a74744dee1f17f89. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:21:58 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-7a989fcc-f2d0-4c2f-9a2a-ef88e6ba15a6 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for user 9803a74b170d457c9cb6c4b1e5ff2e63 and project 973f328b0e474229a74744dee1f17f89. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:21:58 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-7a989fcc-f2d0-4c2f-9a2a-ef88e6ba15a6 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.334355 Apr 20 13:21:58 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:21:58 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "name": "network-vif-plugged", "status": "completed", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:59 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Creating event network-vif-plugged:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61279) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-285ab2a0-99fb-415d-b117-5517d85064f3 req-54897d1d-8960-48b0-b1c2-7f176736e55b service nova] Acquired lock "compute-rpcapi-router" {{(pid=61279) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:21:59 user devstack@n-api.service[61279]: INFO nova.compute.rpcapi [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 20 13:21:59 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] Releasing lock "compute-rpcapi-router" {{(pid=61279) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 20 13:21:59 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-128f887a-266d-4c6f-83a0-3666bfc76e42 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.368494 Apr 20 13:21:59 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 19/61] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:21:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:01 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "name": "network-vif-plugged", "status": "completed", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}, {"name": "network-changed", "server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:01 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:01 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:01 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:01 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Creating event network-vif-plugged:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:22:01 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] Creating event network-changed:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:22:01 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-728fed24-e534-4f43-b475-7284e69f582b req-bd2e1233-edf2-4e3b-be3b-5f2246787795 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.050703 Apr 20 13:22:01 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 23/62] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:01 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:01 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:01 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:01 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:01 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:22:01 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-7e06274e-7fae-4e0b-9876-67aefc6ba0e6 req-fbbc1945-95a5-466b-8213-6850d9c4e954 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064573 Apr 20 13:22:01 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 21/63] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:02 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:02 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] Creating event network-changed:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:22:02 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-bcbb072b-5503-423c-9734-e3d68c782e30 req-95922084-ba44-4761-a0fc-0dcb7b4ab4b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039254 Apr 20 13:22:02 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 20/64] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:04 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:04 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:22:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-ff4061e6-8792-40b5-8627-1d13b0f1c6c3 req-f81f9810-2090-4df6-9cda-b7daed34eaea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046344 Apr 20 13:22:04 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 24/65] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:04 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1183159121", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "b8d53c41-3e3b-44b5-a384-2f38587f8d6a"}], "security_groups": [{"name": "tempest-securitygroup--1185102359"}], "key_name": "tempest-keypair-18511535", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:05 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] validate_networks() for [('b8d53c41-3e3b-44b5-a384-2f38587f8d6a', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:22:06 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "name": "network-vif-plugged", "status": "completed", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] Creating event network-vif-plugged:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:22:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-9bea2150-7f64-42cb-a6a5-dfb4eeb6e3ad req-c939a94a-517a-4027-9739-b9c0f70979a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062128 Apr 20 13:22:06 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 21/66] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:06 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for project 973f328b0e474229a74744dee1f17f89. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for user 9803a74b170d457c9cb6c4b1e5ff2e63 and project 973f328b0e474229a74744dee1f17f89. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:22:07 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:22:08 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-364d517b-9439-4c40-b818-5efdd76f23aa tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.401047 Apr 20 13:22:08 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:22:04 2023] POST /compute/v2.1/servers => generated 404 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:22:08 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-b9da97aa-c2da-452b-9ffa-51007e0e23cc tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:08 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-b9da97aa-c2da-452b-9ffa-51007e0e23cc tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:08 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-b9da97aa-c2da-452b-9ffa-51007e0e23cc tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:08 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-b9da97aa-c2da-452b-9ffa-51007e0e23cc tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496" status: 200 len: 1234 microversion: 2.1 time: 0.098983 Apr 20 13:22:08 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 25/68] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:08 2023] GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 => generated 1234 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:08 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=20 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:08 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "name": "network-vif-plugged", "status": "completed", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:08 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] Creating event network-vif-plugged:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:22:08 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-6ba5dcc9-f78d-48fe-83ce-de4794dca227 req-60ed1b47-e3b8-4070-8db5-e8d4d63e9a7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086888 Apr 20 13:22:08 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 22/69] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:08 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "name": "network-vif-plugged", "status": "completed", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:08 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] Creating event network-vif-plugged:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:22:08 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-423e2e61-0c8a-4684-880b-3a8776abe5d1 req-1a81d1fa-a9a8-4550-b926-114e3df29434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060820 Apr 20 13:22:08 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}, {"server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "name": "network-vif-plugged", "status": "completed", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Creating event network-changed:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:22:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] Creating event network-vif-plugged:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:22:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-556e5bb3-7eca-44ee-a469-3b179cc39e94 req-ff7e51a2-6b62-4393-974c-042e990df2a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.058132 Apr 20 13:22:10 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 26/71] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "name": "network-vif-plugged", "status": "completed", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=8 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=9 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:12 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=17 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:12 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] Creating event network-vif-plugged:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:22:12 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-a0de061a-40f6-4dd9-943e-28f70a6d0917 req-81e45754-870c-42f7-a95f-86b6cde64b0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046119 Apr 20 13:22:12 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 23/72] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "name": "network-vif-plugged", "status": "completed", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=11 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:14 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=15 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:14 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] Creating event network-vif-plugged:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:22:14 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-728d66f2-8627-4fdc-8aaf-d33ecb749fd1 req-d9d0ff85-fee5-4ec9-9824-3b9bb6c1ab4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063006 Apr 20 13:22:14 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 24/73] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:16 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=11 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:16 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] Creating event network-changed:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:22:16 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-70c6fff6-1941-46c3-baeb-8262a72f425e req-a96ffe2d-f320-47ee-abaf-94386dd00ebc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080718 Apr 20 13:22:16 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 27/74] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:20 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-702ebfd7-08f8-4043-8b7e-ba6a1d22f940 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Action: 'create', calling method: .version_select at 0x7f31d94528c0>, body: {"keypair": {"name": "tempest-keypair-1167236637", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI88evilzgjB+1NKaC7Ip06LIsIQAO4Evuybj3KsfBYwfrOw0OGa+/kZzD5aHycaapxHFGaDmjeDtTENWpl2gKstLtxoGzcae+eA6nFoqj2hxc6ZXebj3vVPfeO3vl4wYQ=="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:20 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-702ebfd7-08f8-4043-8b7e-ba6a1d22f940 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Getting quotas for project ec10b3906959443b875a4ee0ad05aa96. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:20 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-702ebfd7-08f8-4043-8b7e-ba6a1d22f940 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Getting quotas for user d2f5a8cd966a4dcfad5583d720e06f68 and project ec10b3906959443b875a4ee0ad05aa96. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:20 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-702ebfd7-08f8-4043-8b7e-ba6a1d22f940 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.282934 Apr 20 13:22:20 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 24/75] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:22:20 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "name": "network-vif-plugged", "status": "completed", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=26 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] Creating event network-vif-plugged:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:22:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-4f709be4-fd66-426a-9aa8-6457170bb7f4 req-fc3e531a-b62e-42ed-b762-250b71291e41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082170 Apr 20 13:22:21 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 25/76] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:23 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=14 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:23 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "name": "network-vif-plugged", "status": "completed", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:23 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] Creating event network-vif-plugged:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:22:23 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-60ea0f70-fbb5-4327-990d-f002419e9655 req-7ebffb38-a1d1-4af9-8054-57ebd4d27e3f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079740 Apr 20 13:22:23 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 28/77] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:24 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1146699155", "imageRef": "b74b4411-c798-48d2-98b1-d090667f58b8", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "2eaca66d-8c0e-47fb-874e-8e6ac7851347"}], "security_groups": [{"name": "tempest-securitygroup--548772807"}], "key_name": "tempest-keypair-1167236637", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:24 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:24 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] validate_networks() for [('2eaca66d-8c0e-47fb-874e-8e6ac7851347', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Getting quotas for project ec10b3906959443b875a4ee0ad05aa96. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Getting quotas for user d2f5a8cd966a4dcfad5583d720e06f68 and project ec10b3906959443b875a4ee0ad05aa96. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:22:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b74b4411-c798-48d2-98b1-d090667f58b8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:22:25 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-3943601a-eda3-410a-931e-4c02d4d39c4c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.269968 Apr 20 13:22:25 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 25/78] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:22:24 2023] POST /compute/v2.1/servers => generated 403 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 20 13:22:25 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a64dc91f-0c75-43db-87aa-5fffbdc973f4 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:25 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a64dc91f-0c75-43db-87aa-5fffbdc973f4 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:25 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a64dc91f-0c75-43db-87aa-5fffbdc973f4 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f5a8cd966a4dcfad5583d720e06f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec10b3906959443b875a4ee0ad05aa96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:25 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a64dc91f-0c75-43db-87aa-5fffbdc973f4 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 200 len: 1240 microversion: 2.1 time: 0.179657 Apr 20 13:22:25 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 26/79] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:25 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 1240 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:31 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] Creating event network-changed:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:22:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-014fa1b9-ebfc-4f89-95fe-c02275bc2dc1 req-5f55895a-5260-4ff8-9ce6-a1d771ee31ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101363 Apr 20 13:22:31 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 29/80] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:34 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "name": "network-vif-plugged", "status": "completed", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] Creating event network-vif-plugged:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:22:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-643fedba-1811-4a73-8af9-fbc0ece3f33d req-a952019a-ea57-40a1-baef-37aa4ebeca93 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032188 Apr 20 13:22:34 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=7 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-f4c75ee4-1afc-46a0-b2a6-e2ed0b0996b0 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: .version_select at 0x7f31d940f0a0>, body: {"keypair": {"name": "tempest-keypair-494975144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2wpSj15gxEgX+W6+RCOxyjWsrBxugzVdx+KZwkjRH305zGO49C8SQAcwDbNfaWl4Em04dwFswrR69FpSIr7Sd7Dfml91kqTSaApF0XRVIh/UfxYAsrn9WLThYZ29AidQ=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-f4c75ee4-1afc-46a0-b2a6-e2ed0b0996b0 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:35 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-f4c75ee4-1afc-46a0-b2a6-e2ed0b0996b0 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:35 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-f4c75ee4-1afc-46a0-b2a6-e2ed0b0996b0 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.286568 Apr 20 13:22:35 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 27/82] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:22:35 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "name": "network-vif-plugged", "status": "completed", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] Creating event network-vif-plugged:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:22:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-b3f7c2c3-40c2-4ddf-a155-fad8efffabd2 req-5ff41bc6-aede-4296-9e49-a6736f5229f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041573 Apr 20 13:22:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 30/83] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=10 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:37 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-380947152", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "95ff1fea-83ff-461e-bfcd-53d8d8d798db"}], "security_groups": [{"name": "tempest-securitygroup--786502006"}], "key_name": "tempest-keypair-494975144", "user_data": "}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:37 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:37 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] validate_networks() for [('95ff1fea-83ff-461e-bfcd-53d8d8d798db', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:22:37 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-5b63d116-34f0-4b93-8f76-a244c3188c7a tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 200 len: 1504 microversion: 2.1 time: 0.543673 Apr 20 13:22:37 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 27/84] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:37 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:22:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:22:38 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-cfa35e03-caa0-41d9-b59e-4ea43509af82 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.153170 Apr 20 13:22:38 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 28/85] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:22:37 2023] POST /compute/v2.1/servers => generated 399 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:22:38 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7941ab12-518b-4ee9-91ab-3dc5c3fde9c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:38 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-7941ab12-518b-4ee9-91ab-3dc5c3fde9c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:38 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7941ab12-518b-4ee9-91ab-3dc5c3fde9c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:38 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-7941ab12-518b-4ee9-91ab-3dc5c3fde9c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 200 len: 1234 microversion: 2.1 time: 0.105974 Apr 20 13:22:38 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 31/86] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:38 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 1234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a6d549ee-5a6b-4ea6-a474-49d015717fa1 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] Action: 'create', calling method: .version_select at 0x7f31d94a8160>, body: {"keypair": {"name": "tempest-TestStampPattern-1108126514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt43xE9mxsnSlP6w363sTu8+781LCn0Qfmw2vYRzpy9TCXd8hi5xY5vVMhhlP9bvb0bWV5L9d4l3KvmjG+uITYXKMheTngPhYS3umuutACUDDOnl4MAzrRF27+WannqEA=="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:39 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-a6d549ee-5a6b-4ea6-a474-49d015717fa1 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] Getting quotas for project ed479802d32d4443bfff66c23408f404. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:22:39 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-a6d549ee-5a6b-4ea6-a474-49d015717fa1 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] Getting quotas for user 2a30e66945704433b911aea603339bf8 and project ed479802d32d4443bfff66c23408f404. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:22:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a6d549ee-5a6b-4ea6-a474-49d015717fa1 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.248218 Apr 20 13:22:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 28/87] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:22:39 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:43 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:43 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] Creating event network-changed:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:22:43 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-2db5cc56-a2b5-4166-9fdd-4232cf457169 req-b7343da2-ab87-4cdf-bcfd-f60be1889605 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033732 Apr 20 13:22:43 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 32/88] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:43 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-699323a8-5b9b-4d39-bb10-7772b05823e4 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] Calling method '.version_select at 0x7f31d94a9a20>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:43 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=5 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-699323a8-5b9b-4d39-bb10-7772b05823e4 tempest-TestStampPattern-1939190449 tempest-TestStampPattern-1939190449-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1108126514" status: 202 len: 0 microversion: 2.1 time: 0.041874 Apr 20 13:22:43 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a150206963a4369b2cab6a71c9188e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb01d14674514d6c8224cee3d42b8750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:43 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 29/89] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:22:43 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1108126514 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:22:43 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-6d397221-6102-44a9-bb50-497652eacdbb tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590" status: 200 len: 1489 microversion: 2.1 time: 0.491313 Apr 20 13:22:43 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 29/90] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:43 2023] GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 => generated 1489 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:45 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "name": "network-vif-plugged", "status": "completed", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] Creating event network-vif-plugged:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:22:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-7d5a53fc-0323-490e-b72a-dab3d1f46754 req-b55c4d4f-e5c6-40a4-ae17-cce4d4730fcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084791 Apr 20 13:22:46 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 33/91] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:45 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:47 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a6ddae38-cfd3-402d-893e-21efd04caec9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1537 microversion: 2.1 time: 0.459015 Apr 20 13:22:47 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 30/92] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:46 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1537 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:48 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "name": "network-vif-plugged", "status": "completed", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:22:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] Creating event network-vif-plugged:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:22:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-3a5ed427-ab1f-4825-91f9-0c1dfffe3b8f req-dca668c5-69ab-461d-a97f-f3c3d059f0aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038389 Apr 20 13:22:48 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:22:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:48 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882cab9c92ed4bfa8682a25169a49d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5d76af78b94668a18adcddc22a8440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:48 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-2b7be5ef-8595-43e4-a922-586f4fd73bed tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 200 len: 1553 microversion: 2.1 time: 0.388169 Apr 20 13:22:48 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 34/94] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:48 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 1553 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=16 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:22:58 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:22:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-1fbefa2e-c4a2-477f-b7f8-3a7d90d9d4f7 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496" status: 200 len: 1544 microversion: 2.1 time: 0.237517 Apr 20 13:22:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 31/95] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:22:58 2023] GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 => generated 1544 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=10 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=10 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-54eb706d-233e-4677-83c7-cfb462ffb5f9 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Action: 'create', calling method: .version_select at 0x7f31d94484c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1727053939"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-54eb706d-233e-4677-83c7-cfb462ffb5f9 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.458642 Apr 20 13:23:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 31/96] 10.0.0.210 () {64 vars in 1232 bytes} [Thu Apr 20 13:23:02 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 461 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 13:23:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-6932924b-2081-45a7-a802-73eff864c194 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Calling method '.version_select at 0x7f31d9c55c60>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:03 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:03 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=17 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:03 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=17 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-6932924b-2081-45a7-a802-73eff864c194 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1" status: 200 len: 342 microversion: 2.1 time: 0.088273 Apr 20 13:23:03 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 35/97] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:23:03 2023] GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1 => generated 342 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:04 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-b253f9f9-9d42-492b-80df-2cc5a2bfc68f tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Calling method '.version_select at 0x7f31d94a9090>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:04 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-b253f9f9-9d42-492b-80df-2cc5a2bfc68f tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1" status: 200 len: 342 microversion: 2.1 time: 0.079070 Apr 20 13:23:04 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 32/98] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:23:04 2023] GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1 => generated 342 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:04 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-3c49eb1f-7908-4826-8386-aefe8ec82e49 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Calling method '.version_select at 0x7f31d9334700>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:04 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-3c49eb1f-7908-4826-8386-aefe8ec82e49 tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1" status: 202 len: 0 microversion: 2.1 time: 0.107763 Apr 20 13:23:04 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 32/99] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:23:04 2023] DELETE /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:23:04 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-55df4589-ab29-4cdc-bf7e-359f3df2f95c tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Calling method '.version_select at 0x7f31d9324d30>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-55df4589-ab29-4cdc-bf7e-359f3df2f95c tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] HTTP exception thrown: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. Apr 20 13:23:04 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-55df4589-ab29-4cdc-bf7e-359f3df2f95c tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Request method failure captured: Apr 20 13:23:04 user devstack@n-api.service[61277]: request: GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1 HTTP/1.1 Apr 20 13:23:04 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:23:04 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:23:04 user devstack@n-api.service[61277]: Connection: close Apr 20 13:23:04 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:23:04 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:23:04 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:23:04 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:23:04 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTy2MQEyyQIvS9ZxQa-jhT8Zjn4VEBNJYlUVkSdUkRJMbt4CWTVmvRDiYNJjoZlMgCW520TUR0Izjymejbl2NaZHDMxVmkLGCYBpv4xjp6P2H99GZDlHu_AehpFaA5Lyxn5XM-R_vLubbwFq2rrAr5n7T281LX_qK9QazbA6Sg9qDQ4 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Project-Id: 4d69534e93874871a6646e0d3d6ccd86 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-178065218 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d69534e93874871a6646e0d3d6ccd86"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4d69534e93874871a6646e0d3d6ccd86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4d69534e93874871a6646e0d3d6ccd86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesSnapshotsTestJSON-178065218 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Tenant-Id: 4d69534e93874871a6646e0d3d6ccd86 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-178065218 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-User: tempest-VolumesSnapshotsTestJSON-178065218-project-member Apr 20 13:23:04 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:23:04 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:23:04 user devstack@n-api.service[61277]: X-User-Id: 1c37b029eb2a47e38ba4b6272b9615c7 Apr 20 13:23:04 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesSnapshotsTestJSON-178065218-project-member Apr 20 13:23:04 user devstack@n-api.service[61277]: method: Apr 20 13:23:04 user devstack@n-api.service[61277]: exception: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. Apr 20 13:23:04 user devstack@n-api.service[61277]: action_args: {'id': '3474481a-410d-4ea5-8fd7-e7a575e635c1'} Apr 20 13:23:04 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. (HTTP 404) (Request-ID: req-0fe00f48-f830-4cd4-9f86-f0c9d3233c38) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. Apr 20 13:23:04 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:04 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-55df4589-ab29-4cdc-bf7e-359f3df2f95c tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] Returning 404 to user: Volume 3474481a-410d-4ea5-8fd7-e7a575e635c1 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-55df4589-ab29-4cdc-bf7e-359f3df2f95c tempest-VolumesSnapshotsTestJSON-178065218 tempest-VolumesSnapshotsTestJSON-178065218-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1" status: 404 len: 109 microversion: 2.1 time: 0.039554 Apr 20 13:23:04 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 36/100] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:23:04 2023] GET /compute/v2.1/os-volumes/3474481a-410d-4ea5-8fd7-e7a575e635c1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-02b1ab9b-1051-4458-a797-de1a5beb58c0 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] Action: 'create', calling method: .version_select at 0x7f31d94aa680>, body: {"keypair": {"name": "tempest-TestShelveInstance-1966230942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPhbgXJrzvToOiwn0H5RKWUoVdZFlfxosZhaHhJkvvfafPXV7sXcdtoSGvdkeba7wVLyQlAZdPxxwTobUXF2hHnE5o02TOoQUM4AG3Z6qKP9ND8g2EKNrD6oPNf1mFeRSg=="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-02b1ab9b-1051-4458-a797-de1a5beb58c0 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] Getting quotas for project 3ad9a02d2f004902b01a92f9fa4853af. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-02b1ab9b-1051-4458-a797-de1a5beb58c0 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] Getting quotas for user 3488675ef9db4a5f893c34e26b77544f and project 3ad9a02d2f004902b01a92f9fa4853af. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:23:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-02b1ab9b-1051-4458-a797-de1a5beb58c0 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.203821 Apr 20 13:23:09 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 33/101] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:23:09 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b962ce4-e1ff-4854-ba5c-5268f5ba0dae tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Action: 'create', calling method: .version_select at 0x7f31d9334d30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-365296694", "metadata": {"Type": "work"}}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b962ce4-e1ff-4854-ba5c-5268f5ba0dae tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:09 user devstack@n-api.service[61278]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:23:09 user devstack@n-api.service[61278]: Connection: close Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Length: 121 Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:23:09 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:23:09 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: Apr 20 13:23:09 user devstack@n-api.service[61278]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-365296694", "metadata": {"Type": "work"}}} Apr 20 13:23:09 user devstack@n-api.service[61278]: method: Apr 20 13:23:09 user devstack@n-api.service[61278]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61278]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-365296694', 'metadata': {'Type': 'work'}}}} Apr 20 13:23:09 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise error Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi '#$%' Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b962ce4-e1ff-4854-ba5c-5268f5ba0dae tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-5b962ce4-e1ff-4854-ba5c-5268f5ba0dae tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.180815 Apr 20 13:23:09 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 33/102] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 13:23:09 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-9c85c655-6464-451a-983d-a70bf7e48d99 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Action: 'create', calling method: .version_select at 0x7f31d9df3370>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-971749701", "metadata": {"Type": "work"}}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-9c85c655-6464-451a-983d-a70bf7e48d99 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:09 user devstack@n-api.service[61277]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 13:23:09 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:23:09 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:23:09 user devstack@n-api.service[61277]: Connection: close Apr 20 13:23:09 user devstack@n-api.service[61277]: Content-Length: 119 Apr 20 13:23:09 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:23:09 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:23:09 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:23:09 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61277]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61277]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:09 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61277]: Apr 20 13:23:09 user devstack@n-api.service[61277]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-971749701", "metadata": {"Type": "work"}}} Apr 20 13:23:09 user devstack@n-api.service[61277]: method: Apr 20 13:23:09 user devstack@n-api.service[61277]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 13:23:09 user devstack@n-api.service[61277]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-971749701', 'metadata': {'Type': 'work'}}}} Apr 20 13:23:09 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise error Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi '0' Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 20 13:23:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-9c85c655-6464-451a-983d-a70bf7e48d99 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-9c85c655-6464-451a-983d-a70bf7e48d99 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012328 Apr 20 13:23:09 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 37/103] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 13:23:09 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-aedfed7e-cf71-4b58-84df-7fce6c11aff1 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Action: 'create', calling method: .version_select at 0x7f31d93b5990>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1182456004", "metadata": {"Type": "work"}}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-aedfed7e-cf71-4b58-84df-7fce6c11aff1 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:09 user devstack@n-api.service[61279]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 20 13:23:09 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:23:09 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:23:09 user devstack@n-api.service[61279]: Connection: close Apr 20 13:23:09 user devstack@n-api.service[61279]: Content-Length: 119 Apr 20 13:23:09 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:23:09 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:23:09 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:23:09 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61279]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61279]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:09 user devstack@n-api.service[61279]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61279]: Apr 20 13:23:09 user devstack@n-api.service[61279]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1182456004", "metadata": {"Type": "work"}}} Apr 20 13:23:09 user devstack@n-api.service[61279]: method: Apr 20 13:23:09 user devstack@n-api.service[61279]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61279]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1182456004', 'metadata': {'Type': 'work'}}}} Apr 20 13:23:09 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise error Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi '' Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 20 13:23:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-aedfed7e-cf71-4b58-84df-7fce6c11aff1 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-aedfed7e-cf71-4b58-84df-7fce6c11aff1 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019402 Apr 20 13:23:09 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 34/104] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 13:23:09 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-29743d41-bbdb-42ce-80f3-d9dab7788382 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Calling method '.version_select at 0x7f31da8b52d0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-29743d41-bbdb-42ce-80f3-d9dab7788382 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] HTTP exception thrown: Volume tempest-invalid-972359467 could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-29743d41-bbdb-42ce-80f3-d9dab7788382 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:09 user devstack@n-api.service[61278]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-972359467 HTTP/1.1 Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:23:09 user devstack@n-api.service[61278]: Connection: close Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:23:09 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:23:09 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: method: Apr 20 13:23:09 user devstack@n-api.service[61278]: exception: Volume tempest-invalid-972359467 could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: action_args: {'id': 'tempest-invalid-972359467'} Apr 20 13:23:09 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-972359467 could not be found. (HTTP 404) (Request-ID: req-1eb314d3-004f-458a-af06-4552b39067ba) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-972359467 could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-972359467 could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-972359467 could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-29743d41-bbdb-42ce-80f3-d9dab7788382 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 404 to user: Volume tempest-invalid-972359467 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-29743d41-bbdb-42ce-80f3-d9dab7788382 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-972359467" status: 404 len: 98 microversion: 2.1 time: 0.052248 Apr 20 13:23:09 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 34/105] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 13:23:09 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-972359467 => generated 98 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-d42bff07-3197-4d80-9213-973923208f3b tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004767 Apr 20 13:23:09 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 38/106] 10.0.0.210 () {62 vars in 1217 bytes} [Thu Apr 20 13:23:09 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-259d51d2-115e-4dab-9e3e-7dea11295167 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006430 Apr 20 13:23:09 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1214 bytes} [Thu Apr 20 13:23:09 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-52cdd198-0430-4171-83c4-26ca901f6b42 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Calling method '.version_select at 0x7f31d9336950>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-52cdd198-0430-4171-83c4-26ca901f6b42 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] HTTP exception thrown: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-52cdd198-0430-4171-83c4-26ca901f6b42 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:09 user devstack@n-api.service[61278]: request: DELETE /compute/v2.1/os-volumes/7a4a793c-af50-4bfe-a46d-16f5b5fe579b HTTP/1.1 Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:23:09 user devstack@n-api.service[61278]: Connection: close Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:23:09 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:23:09 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:23:09 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:23:09 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:09 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:09 user devstack@n-api.service[61278]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:09 user devstack@n-api.service[61278]: method: Apr 20 13:23:09 user devstack@n-api.service[61278]: exception: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: action_args: {'id': '7a4a793c-af50-4bfe-a46d-16f5b5fe579b'} Apr 20 13:23:09 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. (HTTP 404) (Request-ID: req-f04e86e5-285d-420c-a1b9-3428b2d5cb74) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:09 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. Apr 20 13:23:10 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-52cdd198-0430-4171-83c4-26ca901f6b42 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 404 to user: Volume 7a4a793c-af50-4bfe-a46d-16f5b5fe579b could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:10 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-52cdd198-0430-4171-83c4-26ca901f6b42 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/7a4a793c-af50-4bfe-a46d-16f5b5fe579b" status: 404 len: 109 microversion: 2.1 time: 0.048615 Apr 20 13:23:10 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 35/108] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:23:09 2023] DELETE /compute/v2.1/os-volumes/7a4a793c-af50-4bfe-a46d-16f5b5fe579b => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:23:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-947c4ea8-2192-4430-ac35-3409db5cc2a2 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Calling method '.version_select at 0x7f31d9327910>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-947c4ea8-2192-4430-ac35-3409db5cc2a2 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] HTTP exception thrown: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. Apr 20 13:23:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-947c4ea8-2192-4430-ac35-3409db5cc2a2 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Request method failure captured: Apr 20 13:23:10 user devstack@n-api.service[61277]: request: GET /compute/v2.1/os-volumes/9b5aeb9e-2074-493e-a55b-d764545ad0ce HTTP/1.1 Apr 20 13:23:10 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:23:10 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:23:10 user devstack@n-api.service[61277]: Connection: close Apr 20 13:23:10 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:23:10 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:23:10 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:23:10 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:23:10 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTy9K8EjZXUpsuPCHkmfgQr8diCYHajmvIou1z8Wvwih2j-rKCj1AwVjmAlHal1KuXKnGuKHN6jZaG-PkbE7fmp-uSlJpE1RyEz54MYow0VFW_XphI2IXgVqWnQvj0PXAM7eV4vpzzV3FjLSm9I7rrEfKpJqIkVT88kZ4h7elq-3B00 Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Project-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/516116771cdf4f1bb1fedd70ff449d9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Tenant-Id: 516116771cdf4f1bb1fedd70ff449d9b Apr 20 13:23:10 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesNegativeTest-1063055725 Apr 20 13:23:10 user devstack@n-api.service[61277]: X-User: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:10 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:23:10 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:23:10 user devstack@n-api.service[61277]: X-User-Id: d65b1098822945f4b90c06cb37b2515d Apr 20 13:23:10 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesNegativeTest-1063055725-project-member Apr 20 13:23:10 user devstack@n-api.service[61277]: method: Apr 20 13:23:10 user devstack@n-api.service[61277]: exception: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. Apr 20 13:23:10 user devstack@n-api.service[61277]: action_args: {'id': '9b5aeb9e-2074-493e-a55b-d764545ad0ce'} Apr 20 13:23:10 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. (HTTP 404) (Request-ID: req-afc596d0-bffd-4e56-a0a5-a0c3f95f021d) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. Apr 20 13:23:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:23:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-947c4ea8-2192-4430-ac35-3409db5cc2a2 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] Returning 404 to user: Volume 9b5aeb9e-2074-493e-a55b-d764545ad0ce could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:23:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-947c4ea8-2192-4430-ac35-3409db5cc2a2 tempest-VolumesNegativeTest-1063055725 tempest-VolumesNegativeTest-1063055725-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/9b5aeb9e-2074-493e-a55b-d764545ad0ce" status: 404 len: 109 microversion: 2.1 time: 0.053516 Apr 20 13:23:10 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 39/109] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:23:10 2023] GET /compute/v2.1/os-volumes/9b5aeb9e-2074-493e-a55b-d764545ad0ce => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:23:12 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6a8a4ac5-26e2-4c49-b88d-e9ede15bbc66 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] Calling method '.version_select at 0x7f31da7484c0>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:12 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-6a8a4ac5-26e2-4c49-b88d-e9ede15bbc66 tempest-TestShelveInstance-1278803085 tempest-TestShelveInstance-1278803085-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1966230942" status: 202 len: 0 microversion: 2.1 time: 0.026795 Apr 20 13:23:12 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 36/110] 10.0.0.210 () {62 vars in 1331 bytes} [Thu Apr 20 13:23:12 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1966230942 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:16 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f5a8cd966a4dcfad5583d720e06f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec10b3906959443b875a4ee0ad05aa96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:16 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0a845d9c-caba-4727-9105-7ceee22e7ade tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 200 len: 1549 microversion: 2.1 time: 0.342242 Apr 20 13:23:16 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 36/111] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:15 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 1549 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:28 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:29 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:29 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-9bc840b6-8e7b-4d49-868a-b703b787f4d5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 200 len: 1543 microversion: 2.1 time: 0.223161 Apr 20 13:23:29 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 40/112] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:28 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 1543 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:37 user devstack@n-api.service[61279]: DEBUG nova.objects.instance [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lazy-loading 'flavor' on Instance uuid b217e938-1848-4803-900b-df6c8f0ed355 {{(pid=61279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 13:23:38 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-361fd3a9-948e-4a6e-958a-fdd81cd22dee tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355/action" status: 200 len: 32 microversion: 2.1 time: 0.468050 Apr 20 13:23:38 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 37/113] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 13:23:37 2023] POST /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355/action => generated 32 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:38 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:38 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a702bc32-815f-42bd-852c-fe41117a63d1 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 200 len: 1510 microversion: 2.1 time: 0.290728 Apr 20 13:23:38 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 37/114] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:38 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 1510 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:39 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-unplugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:39 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:23:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:39 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] Creating event network-vif-unplugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:23:39 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-3ee5df83-20c9-4ac7-81ae-80e05ebcda04 req-21c36b63-0398-4a91-909f-e8214141e83a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032134 Apr 20 13:23:39 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 41/115] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:41 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:23:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-50664a15-d228-4700-8deb-25c530df2678 req-80b58505-67b9-44fb-a858-b635492914f3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028805 Apr 20 13:23:41 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 38/116] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:43 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}, {"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:43 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:23:43 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:23:43 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-ed08f38b-7342-4929-b90c-2b10783c0882 req-6e3e199f-1281-4b9b-b1f2-6c0484bbdf7c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029932 Apr 20 13:23:43 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 38/117] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:43 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:45 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:23:45 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-3074edc4-2292-44ab-bb04-b18af66868f2 tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590" status: 204 len: 0 microversion: 2.1 time: 0.189746 Apr 20 13:23:45 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 42/118] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:23:45 2023] DELETE /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:45 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "name": "network-vif-unplugged", "status": "completed", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:45 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] Creating event network-vif-unplugged:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:23:45 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-8be775e9-729b-46e5-a5d6-4c8dd2ba0408 req-e4fe9395-1b34-4cfb-9e5d-4957b00cf91c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064444 Apr 20 13:23:45 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 39/119] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:46 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a150206963a4369b2cab6a71c9188e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb01d14674514d6c8224cee3d42b8750', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-1888761f-9968-43db-a7f6-d177d74a5e8a tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590" status: 200 len: 1495 microversion: 2.1 time: 0.540353 Apr 20 13:23:46 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 39/120] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:45 2023] GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 => generated 1495 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:47 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "name": "network-vif-deleted", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:47 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] Creating event network-vif-deleted:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:23:47 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-faa1b5bd-9e95-4da5-b893-2c8d8e1f7141 req-7eccfa5f-9e1d-4b67-93da-bd823e34cd92 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039983 Apr 20 13:23:47 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 43/121] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:47 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0cb9e9b4-904a-496f-9d00-2581ad6bf079 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.222167 Apr 20 13:23:47 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 40/122] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:23:47 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57/os-interface => generated 282 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:47 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "305bcf70-fd44-49a1-9b7d-1c61c2af3590", "name": "network-vif-plugged", "status": "completed", "tag": "6926e16d-d9fe-400a-bd29-b267424a7570"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] Creating event network-vif-plugged:6926e16d-d9fe-400a-bd29-b267424a7570 for instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 on user Apr 20 13:23:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-c29dd5f4-a1ab-4892-9984-f36f791a7436 req-770761ae-96a1-4df6-9a60-26773da70bf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028461 Apr 20 13:23:47 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 40/123] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:49 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-b5e6a177-cf54-4358-a997-630c402e97e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1537 microversion: 2.1 time: 0.210424 Apr 20 13:23:49 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 41/124] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:49 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1537 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:49 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] Creating event network-changed:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:23:49 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-b06e8827-82f1-4e9f-9b32-95b88d49d39c req-b73c6e0e-5f6c-4e68-9744-983097081e49 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034066 Apr 20 13:23:49 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 42/125] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:49 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-373c520c-2f83-4f08-afc9-4d9ca8eaafea tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.683237 Apr 20 13:23:49 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 44/126] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:23:48 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6/os-interface => generated 282 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:49 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:23:49 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-02a97dfd-e52c-40b2-b402-c033d7d27177 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1537 microversion: 2.1 time: 0.221178 Apr 20 13:23:49 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 41/127] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:23:49 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1537 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-56792286"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:51 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:51 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] Creating event network-changed:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:23:51 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-a0792335-5c85-406e-a3af-039279d3c066 req-6bfc9dfa-07ae-4ee2-b21f-6421fe1b66ee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032335 Apr 20 13:23:51 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 45/128] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:51 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-f0f3d6fe-105c-4dbe-af87-b5a5c4b632ff tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6/action" status: 202 len: 0 microversion: 2.1 time: 1.240775 Apr 20 13:23:51 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 43/129] 10.0.0.210 () {64 vars in 1355 bytes} [Thu Apr 20 13:23:50 2023] POST /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6/action => generated 0 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 20 13:23:51 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-afb3de66-a1b6-43f7-a7d9-0843b4f99217 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '.version_select at 0x7f31d93b75b0>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:51 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-afb3de66-a1b6-43f7-a7d9-0843b4f99217 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95" status: 200 len: 1609 microversion: 2.1 time: 0.054785 Apr 20 13:23:51 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 42/130] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 13:23:51 2023] GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95 => generated 1609 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-3d8753e1-8121-486d-906f-bbec881733ad tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.163978 Apr 20 13:23:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 46/131] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:23:58 2023] GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496/os-interface => generated 283 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:23:59 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:23:59 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:23:59 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:23:59 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:23:59 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] Creating event network-changed:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:23:59 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-672678ad-6bf5-49d3-9df8-5dfdfa9e3a14 req-6ef3d0d8-3364-479d-99ca-e41f9fb7903d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036040 Apr 20 13:23:59 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 44/132] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:23:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=10 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2033529697", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "b8d53c41-3e3b-44b5-a384-2f38587f8d6a"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] validate_networks() for [('b8d53c41-3e3b-44b5-a384-2f38587f8d6a', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for project 973f328b0e474229a74744dee1f17f89. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Getting quotas for user 9803a74b170d457c9cb6c4b1e5ff2e63 and project 973f328b0e474229a74744dee1f17f89. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:24:01 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:24:02 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-ecc16f96-b9d9-4a5c-81fd-04435149bff9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.556590 Apr 20 13:24:02 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 43/133] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:24:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:24:02 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-45cd78c7-0b50-4e98-9dd3-41b7d5efcbcf tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:02 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-45cd78c7-0b50-4e98-9dd3-41b7d5efcbcf tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:02 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-45cd78c7-0b50-4e98-9dd3-41b7d5efcbcf tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:02 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-45cd78c7-0b50-4e98-9dd3-41b7d5efcbcf tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868" status: 200 len: 1212 microversion: 2.1 time: 0.103557 Apr 20 13:24:02 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 47/134] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:02 2023] GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 => generated 1212 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:04 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:04 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:04 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:04 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:04 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] Creating event network-changed:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:24:04 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-deacbb78-270b-449a-a398-7e4a24d74161 req-b91548ed-27cd-44f4-baca-94a91d6e63cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029310 Apr 20 13:24:04 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 45/135] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:06 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "name": "network-vif-plugged", "status": "completed", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] Creating event network-vif-plugged:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:24:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-3a26adf6-78ab-4dd6-83be-5d81e10782fb req-976144b0-15e4-49ab-9058-8ddfc70d6d5c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029188 Apr 20 13:24:06 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 44/136] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:08 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "name": "network-vif-plugged", "status": "completed", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:08 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:08 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:08 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:08 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:08 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] Creating event network-vif-plugged:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:24:08 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-883a3a76-5507-49cd-8589-a4289b815531 req-86929b0f-53c7-4298-83df-956ce9a56943 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054971 Apr 20 13:24:08 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 48/137] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=18 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:16 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-66b292a5-a150-41ab-854d-de55bd528355 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.235401 Apr 20 13:24:16 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 46/138] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:24:16 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809/os-interface => generated 282 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:17 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] Creating event network-changed:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:24:17 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-4349a316-c941-41f0-bf35-24990e962ada req-5db4e794-dd92-40cb-93c2-595e79d172ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044019 Apr 20 13:24:17 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 45/139] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:18 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:24:18 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-d7cd0f2f-efc8-4dd7-826e-2e4a933b87e2 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 204 len: 0 microversion: 2.1 time: 0.121163 Apr 20 13:24:18 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 49/140] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:24:18 2023] DELETE /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:18 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:19 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f5a8cd966a4dcfad5583d720e06f68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec10b3906959443b875a4ee0ad05aa96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:19 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a7e43890-cb7e-4079-a675-cb99eeefa256 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 200 len: 1674 microversion: 2.1 time: 0.184263 Apr 20 13:24:19 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 47/141] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:18 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:19 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "name": "network-vif-unplugged", "status": "completed", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:19 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] Creating event network-vif-unplugged:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:24:19 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-6c63f286-2eb0-4e4c-b023-4102bfc70064 req-5dd09251-4882-4d24-b53d-ef661d214c9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030209 Apr 20 13:24:19 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 46/142] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:21 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "name": "network-vif-plugged", "status": "completed", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}, {"server_uuid": "b837ac35-fb44-4242-8ad0-bb21554d5809", "name": "network-vif-deleted", "tag": "30ff1b32-5c42-46ad-8642-c74cf51c4174"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:21 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Creating event network-vif-plugged:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:24:21 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] Creating event network-vif-deleted:30ff1b32-5c42-46ad-8642-c74cf51c4174 for instance b837ac35-fb44-4242-8ad0-bb21554d5809 on user Apr 20 13:24:21 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-f1f7c9ee-c7ea-412f-88b0-0d7861ffbddc req-566d2571-0a1b-48bc-8367-4162d0e87d1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033689 Apr 20 13:24:21 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 50/143] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:21 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:28 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:28 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-352b5902-a3d8-42c0-aebd-0885243be2cc tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 200 len: 1490 microversion: 2.1 time: 0.235027 Apr 20 13:24:28 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 48/144] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:28 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 1490 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:29 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-8bc42558-b868-44ca-85a7-c3aff54ba9d7 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.197209 Apr 20 13:24:29 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 47/145] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:24:29 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5/os-interface => generated 283 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:30 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] Creating event network-changed:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:24:30 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-071ad630-e205-4f3f-bd65-0797d913a10a req-5d444a76-0119-46fb-9209-0e0e0b783638 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Apr 20 13:24:30 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 51/146] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-1c57ef65-2683-4f40-b243-b00970309577 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5/ips" status: 200 len: 108 microversion: 2.1 time: 0.036274 Apr 20 13:24:30 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 49/147] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:24:30 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5/ips => generated 108 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:32 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:24:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-8f65665c-5b3f-4a78-8346-793395a244ca tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 204 len: 0 microversion: 2.1 time: 0.122081 Apr 20 13:24:32 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 48/148] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:24:32 2023] DELETE /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:32 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "name": "network-vif-unplugged", "status": "completed", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-b44554ba-9429-4567-ab9c-231451c45c52 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 200 len: 1668 microversion: 2.1 time: 0.246683 Apr 20 13:24:32 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 52/149] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:32 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:32 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] Creating event network-vif-unplugged:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:24:32 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-8a6d6800-b5c2-4176-a329-130263bfc47c req-fd664c4e-f1c7-4de2-8588-d4ba830de33b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031726 Apr 20 13:24:32 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 50/150] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:24:34 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "name": "network-vif-plugged", "status": "completed", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}, {"server_uuid": "36408db4-ec52-4295-9e62-efa2a32acad5", "name": "network-vif-deleted", "tag": "e42b33bb-627e-48f7-b25a-a232ca745a63"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Creating event network-vif-plugged:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:24:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] Creating event network-vif-deleted:e42b33bb-627e-48f7-b25a-a232ca745a63 for instance 36408db4-ec52-4295-9e62-efa2a32acad5 on user Apr 20 13:24:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-417b10ea-f8ae-4bc9-927d-908d2ebcc2d0 req-3923fd5e-5eda-4b7f-a090-91212a04b397 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034325 Apr 20 13:24:34 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 49/151] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] [instance: 305bcf70-fd44-49a1-9b7d-1c61c2af3590] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] HTTP exception thrown: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Request method failure captured: Apr 20 13:24:36 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 HTTP/1.1 Apr 20 13:24:36 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:24:36 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:24:36 user devstack@n-api.service[61277]: Connection: close Apr 20 13:24:36 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:24:36 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:24:36 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:24:36 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:24:36 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxuJWLhAgaZjlFmYS43f3BWJQHcQU51-NlsIOGc6uo_gxImjMMaPWZ0bnFE4BfY3RW-L9AghhDnNL0E9sv0-O0uiZHzSfiIWPUie8iccVD0qNCsMrb5J_wYGkxk_MEetl33ZTCnRdNG8Ns4CZy3LNvGHAHJPefaOcSJIakG-YzsyMI Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Project-Id: eb01d14674514d6c8224cee3d42b8750 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Project-Name: tempest-DeleteServersTestJSON-1690361794 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb01d14674514d6c8224cee3d42b8750"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/eb01d14674514d6c8224cee3d42b8750"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/eb01d14674514d6c8224cee3d42b8750"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Tenant: tempest-DeleteServersTestJSON-1690361794 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Tenant-Id: eb01d14674514d6c8224cee3d42b8750 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-DeleteServersTestJSON-1690361794 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-User: tempest-DeleteServersTestJSON-1690361794-project-member Apr 20 13:24:36 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:24:36 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:24:36 user devstack@n-api.service[61277]: X-User-Id: 2a150206963a4369b2cab6a71c9188e1 Apr 20 13:24:36 user devstack@n-api.service[61277]: X-User-Name: tempest-DeleteServersTestJSON-1690361794-project-member Apr 20 13:24:36 user devstack@n-api.service[61277]: method: > Apr 20 13:24:36 user devstack@n-api.service[61277]: exception: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. Apr 20 13:24:36 user devstack@n-api.service[61277]: action_args: {'id': '305bcf70-fd44-49a1-9b7d-1c61c2af3590'} Apr 20 13:24:36 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. Apr 20 13:24:36 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:24:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] Returning 404 to user: Instance 305bcf70-fd44-49a1-9b7d-1c61c2af3590 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:24:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-266905b5-0570-40cd-b850-aa88793ef0ae tempest-DeleteServersTestJSON-1690361794 tempest-DeleteServersTestJSON-1690361794-project-member] 10.0.0.210 "GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590" status: 404 len: 111 microversion: 2.1 time: 0.033900 Apr 20 13:24:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 53/152] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:36 2023] GET /compute/v2.1/servers/305bcf70-fd44-49a1-9b7d-1c61c2af3590 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:39 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:39 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-19862b9c-7211-4cf3-aca8-8bd5b7cf45ea tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.231039 Apr 20 13:24:39 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 51/153] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:39 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:40 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:40 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-d3dc65ed-41ce-4302-a599-c896dbd4872e tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.219705 Apr 20 13:24:40 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 50/154] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:39 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:41 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-0f9024d2-0205-42c7-9cf4-daff235a49ee tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '.version_select at 0x7f31d929feb0>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:41 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-0f9024d2-0205-42c7-9cf4-daff235a49ee tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95" status: 200 len: 1723 microversion: 2.1 time: 0.060282 Apr 20 13:24:41 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 54/155] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 13:24:41 2023] GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95 => generated 1723 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:41 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0a582cc2-d78a-4f93-a1e7-c684f4d3dea3 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '.version_select at 0x7f31d9334dc0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:41 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0a582cc2-d78a-4f93-a1e7-c684f4d3dea3 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95" status: 200 len: 1723 microversion: 2.1 time: 0.052476 Apr 20 13:24:41 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 52/156] 10.0.0.210 () {62 vars in 1310 bytes} [Thu Apr 20 13:24:41 2023] GET /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95 => generated 1723 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:42 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882cab9c92ed4bfa8682a25169a49d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5d76af78b94668a18adcddc22a8440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:42 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-cc60a6d4-e250-47ab-9475-2017284962a5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 200 len: 1672 microversion: 2.1 time: 0.217057 Apr 20 13:24:42 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 51/157] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:41 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 1672 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:46 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:46 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:46 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1993764424", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "86c2146e-b829-46d4-924c-49a08f1e1d95"}]}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:46 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] validate_networks() for [('86c2146e-b829-46d4-924c-49a08f1e1d95', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Getting quotas for project 2c8d7672015e428e807dcb7e0fb58f60. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Getting quotas for user 404bd455b1834e68b508de3f651146d5 and project 2c8d7672015e428e807dcb7e0fb58f60. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:24:47 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:24:47 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-cf720b35-589c-4d39-9321-fbe6a88e4039 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.906576 Apr 20 13:24:47 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 55/158] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:24:46 2023] POST /compute/v2.1/servers => generated 378 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:24:47 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-7e32dc7b-c8b0-444f-87c8-f7461e4c88de tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:47 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-7e32dc7b-c8b0-444f-87c8-f7461e4c88de tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:47 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=13 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:47 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-7e32dc7b-c8b0-444f-87c8-f7461e4c88de tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404bd455b1834e68b508de3f651146d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d7672015e428e807dcb7e0fb58f60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:47 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-7e32dc7b-c8b0-444f-87c8-f7461e4c88de tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c" status: 200 len: 1208 microversion: 2.1 time: 0.068748 Apr 20 13:24:47 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 53/159] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:47 2023] GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c => generated 1208 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:50 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] Creating event network-changed:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:24:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-adaeb58b-730e-48c0-963a-c0aa95afdf8a req-ee6ba34c-983e-4e05-9096-3dd4295f0670 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037057 Apr 20 13:24:50 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 52/160] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:52 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "name": "network-vif-plugged", "status": "completed", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] Creating event network-vif-plugged:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:24:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-4c872f50-0a31-43e1-aed9-cdb4139ef547 req-1df954a3-3b2f-4dc0-bd8f-cb1eb6a343d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047903 Apr 20 13:24:52 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 56/161] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=28 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:52 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:24:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-59b383f2-b0ae-4a85-bbc9-9ad6831dfe7b tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868" status: 200 len: 1495 microversion: 2.1 time: 0.252839 Apr 20 13:24:52 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 54/162] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:24:52 2023] GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 => generated 1495 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:24:54 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "name": "network-vif-plugged", "status": "completed", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:24:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:24:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:24:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:24:54 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] Creating event network-vif-plugged:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:24:54 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-f15d8f6d-045c-4c3d-89bb-110b80a40863 req-4984ff75-b0c5-41f1-bc28-fdee153ea051 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027438 Apr 20 13:24:54 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 53/163] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:24:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] HTTP exception thrown: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Request method failure captured: Apr 20 13:25:09 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 HTTP/1.1 Apr 20 13:25:09 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:25:09 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:25:09 user devstack@n-api.service[61277]: Connection: close Apr 20 13:25:09 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:25:09 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:25:09 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:25:09 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:25:09 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxm11WE_CcGxgoSNc7DzbZ60akfyHsFCZ4ZqhSOLG3hdNGn9ZWcbjgz_53LX1ZhWtpFMfkOqiRxg1-v91JEIK2JdmwE0BJe2XAfkHVKK4Yz1OFQurivLz1IPS2fCobTWHrRO-Ti0TKf9r5VfOQKGuYFozG25c_hGZmcrKjJutDETgs Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Project-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Tenant-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-User: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:09 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:25:09 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:25:09 user devstack@n-api.service[61277]: X-User-Id: d2f5a8cd966a4dcfad5583d720e06f68 Apr 20 13:25:09 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:09 user devstack@n-api.service[61277]: method: > Apr 20 13:25:09 user devstack@n-api.service[61277]: exception: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:09 user devstack@n-api.service[61277]: action_args: {'id': 'b837ac35-fb44-4242-8ad0-bb21554d5809'} Apr 20 13:25:09 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:09 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Returning 404 to user: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:25:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-d3df4f6b-4988-484f-8f77-23b7e5027e22 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 404 len: 111 microversion: 2.1 time: 0.036516 Apr 20 13:25:09 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 57/164] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:09 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:25:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-6a4b152d-e41d-4710-adda-4252aaeaf8fd tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '.version_select at 0x7f31d93377f0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:09 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=5 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:09 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-6a4b152d-e41d-4710-adda-4252aaeaf8fd tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167236637" status: 202 len: 0 microversion: 2.1 time: 0.102516 Apr 20 13:25:09 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 55/165] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 13:25:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1167236637 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:10 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] HTTP exception thrown: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Request method failure captured: Apr 20 13:25:10 user devstack@n-api.service[61279]: request: DELETE /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 HTTP/1.1 Apr 20 13:25:10 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:25:10 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:25:10 user devstack@n-api.service[61279]: Connection: close Apr 20 13:25:10 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:25:10 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:25:10 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:25:10 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:25:10 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTxm11WE_CcGxgoSNc7DzbZ60akfyHsFCZ4ZqhSOLG3hdNGn9ZWcbjgz_53LX1ZhWtpFMfkOqiRxg1-v91JEIK2JdmwE0BJe2XAfkHVKK4Yz1OFQurivLz1IPS2fCobTWHrRO-Ti0TKf9r5VfOQKGuYFozG25c_hGZmcrKjJutDETgs Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Project-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Tenant-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-User: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:10 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:25:10 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:25:10 user devstack@n-api.service[61279]: X-User-Id: d2f5a8cd966a4dcfad5583d720e06f68 Apr 20 13:25:10 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:10 user devstack@n-api.service[61279]: method: > Apr 20 13:25:10 user devstack@n-api.service[61279]: exception: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61279]: action_args: {'id': 'b837ac35-fb44-4242-8ad0-bb21554d5809'} Apr 20 13:25:10 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Returning 404 to user: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:25:10 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-b3c6ed2c-c347-4156-b5dc-90a33dfe0932 tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 404 len: 111 microversion: 2.1 time: 0.037013 Apr 20 13:25:10 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 54/166] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:25:10 2023] DELETE /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] [instance: b837ac35-fb44-4242-8ad0-bb21554d5809] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] HTTP exception thrown: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Request method failure captured: Apr 20 13:25:10 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 HTTP/1.1 Apr 20 13:25:10 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:25:10 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:25:10 user devstack@n-api.service[61277]: Connection: close Apr 20 13:25:10 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:25:10 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:25:10 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:25:10 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:25:10 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxm11WE_CcGxgoSNc7DzbZ60akfyHsFCZ4ZqhSOLG3hdNGn9ZWcbjgz_53LX1ZhWtpFMfkOqiRxg1-v91JEIK2JdmwE0BJe2XAfkHVKK4Yz1OFQurivLz1IPS2fCobTWHrRO-Ti0TKf9r5VfOQKGuYFozG25c_hGZmcrKjJutDETgs Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Project-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ec10b3906959443b875a4ee0ad05aa96"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Tenant-Id: ec10b3906959443b875a4ee0ad05aa96 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1421167184 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-User: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:10 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:25:10 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:25:10 user devstack@n-api.service[61277]: X-User-Id: d2f5a8cd966a4dcfad5583d720e06f68 Apr 20 13:25:10 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1421167184-project-member Apr 20 13:25:10 user devstack@n-api.service[61277]: method: > Apr 20 13:25:10 user devstack@n-api.service[61277]: exception: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61277]: action_args: {'id': 'b837ac35-fb44-4242-8ad0-bb21554d5809'} Apr 20 13:25:10 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. Apr 20 13:25:10 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:25:10 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] Returning 404 to user: Instance b837ac35-fb44-4242-8ad0-bb21554d5809 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:25:10 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-c173b7df-a1a6-42c4-8c9c-a5d4ee44316c tempest-AttachSCSIVolumeTestJSON-1421167184 tempest-AttachSCSIVolumeTestJSON-1421167184-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809" status: 404 len: 111 microversion: 2.1 time: 0.032230 Apr 20 13:25:10 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 58/167] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:10 2023] GET /compute/v2.1/servers/b837ac35-fb44-4242-8ad0-bb21554d5809 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:22 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:25:22 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 HTTP/1.1 Apr 20 13:25:22 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:25:22 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:25:22 user devstack@n-api.service[61278]: Connection: close Apr 20 13:25:22 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:25:22 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:25:22 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:25:22 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:25:22 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:25:22 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:25:22 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:25:22 user devstack@n-api.service[61278]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:25:22 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:25:22 user devstack@n-api.service[61278]: method: > Apr 20 13:25:22 user devstack@n-api.service[61278]: exception: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:25:22 user devstack@n-api.service[61278]: action_args: {'id': '36408db4-ec52-4295-9e62-efa2a32acad5'} Apr 20 13:25:22 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:25:22 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:25:22 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:25:22 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9ae1a2a9-3aaf-4650-bf90-64c79215b2a1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 404 len: 111 microversion: 2.1 time: 0.037693 Apr 20 13:25:22 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 56/168] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:22 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:25:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3372797f-39d8-4ef9-8bf3-21d4094278c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '.version_select at 0x7f31d91b2290>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:22 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:22 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-3372797f-39d8-4ef9-8bf3-21d4094278c1 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-494975144" status: 202 len: 0 microversion: 2.1 time: 0.031648 Apr 20 13:25:22 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 55/169] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 13:25:22 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-494975144 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:25:23 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ee11f666-76c0-49e5-9b0d-d751498b35d9 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: .version_select at 0x7f31d9164790>, body: {"keypair": {"name": "tempest-keypair-1463405458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+GjFsRSa1ADtwcSt96smVN2zAhhRVJHoNruhDRc/tC2IYvOyqjTjm2j3q09myeSRiG65Ag9BGh6GHRWpaIVdkpte0LImRklLhRxrom3wYcvaYc1iAvXYzRFPhk2G5+5Q=="}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:23 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:23 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:23 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-ee11f666-76c0-49e5-9b0d-d751498b35d9 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:25:23 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-ee11f666-76c0-49e5-9b0d-d751498b35d9 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:25:23 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ee11f666-76c0-49e5-9b0d-d751498b35d9 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.077940 Apr 20 13:25:23 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 59/170] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:25:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:23 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9ae547b1-735a-4abb-b32a-ff98bd58da7c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Action: 'create', calling method: .version_select at 0x7f31d912a560>, body: {"keypair": {"name": "tempest-keypair-2047423207", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhBj1/epH3ckiDuj8GSQEzgbcnnK29CZIvXK39nQFjhN0LAgUKB4oOQU80LVJqXNk/saplUb00CzcE74yq8zZoy0xqEQunRaeLTx0utkTqr9QdXv10gSDWtPLaBX/XVqA=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:23 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-9ae547b1-735a-4abb-b32a-ff98bd58da7c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for project e70d7b30abc14fcab2ffb23660891757. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:25:23 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-9ae547b1-735a-4abb-b32a-ff98bd58da7c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for user d10d3929c7314a639db592a13ffca375 and project e70d7b30abc14fcab2ffb23660891757. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:25:23 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9ae547b1-735a-4abb-b32a-ff98bd58da7c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.149666 Apr 20 13:25:23 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 57/171] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:25:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1606642059", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "95ff1fea-83ff-461e-bfcd-53d8d8d798db"}], "security_groups": [{"name": "tempest-securitygroup--1251439069"}], "key_name": "tempest-keypair-1463405458", "user_data": "}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:25 user devstack@n-api.service[61279]: Exception ignored in: . at 0x7f31d91b2950> Apr 20 13:25:25 user devstack@n-api.service[61279]: Traceback (most recent call last): Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 498, in Apr 20 13:25:25 user devstack@n-api.service[61279]: and _finalize_fairy(None, rec, pool, ref, echo, True), Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 790, in _finalize_fairy Apr 20 13:25:25 user devstack@n-api.service[61279]: connection_record.checkin() Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/pool/base.py", line 531, in checkin Apr 20 13:25:25 user devstack@n-api.service[61279]: pool.dispatch.checkin(connection, self) Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/sqlalchemy/event/attr.py", line 334, in __call__ Apr 20 13:25:25 user devstack@n-api.service[61279]: fn(*args, **kw) Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py", line 52, in _thread_yield Apr 20 13:25:25 user devstack@n-api.service[61279]: time.sleep(0) Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 36, in sleep Apr 20 13:25:25 user devstack@n-api.service[61279]: hub.switch() Apr 20 13:25:25 user devstack@n-api.service[61279]: File "/usr/local/lib/python3.10/dist-packages/eventlet/hubs/hub.py", line 313, in switch Apr 20 13:25:25 user devstack@n-api.service[61279]: return self.greenlet.switch() Apr 20 13:25:25 user devstack@n-api.service[61279]: TimeoutError: timed out Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] validate_networks() for [('95ff1fea-83ff-461e-bfcd-53d8d8d798db', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2035473570", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c12dfbdc-6f7e-4ec1-a667-d1ba4e061da3"}], "security_groups": [{"name": "tempest-securitygroup--1902816583"}], "key_name": "tempest-keypair-2047423207", "user_data": "}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] validate_networks() for [('c12dfbdc-6f7e-4ec1-a667-d1ba4e061da3', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:25:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:25 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:26 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for project e70d7b30abc14fcab2ffb23660891757. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:25:26 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for user d10d3929c7314a639db592a13ffca375 and project e70d7b30abc14fcab2ffb23660891757. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:25:26 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:25:26 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:25:26 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f48cc5fa-47a7-477b-9315-1f3cbd4360a5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.669742 Apr 20 13:25:26 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 60/172] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:25:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:25:26 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-8fd54a0c-946f-4661-bdf5-413e08f28e05 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:26 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-8fd54a0c-946f-4661-bdf5-413e08f28e05 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:26 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-8fd54a0c-946f-4661-bdf5-413e08f28e05 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:26 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-8fd54a0c-946f-4661-bdf5-413e08f28e05 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 200 len: 1232 microversion: 2.1 time: 0.070636 Apr 20 13:25:26 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 58/173] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:26 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 1232 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:29 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:29 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:29 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:29 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:29 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] Creating event network-changed:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:25:29 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-7e747ea0-d3d7-4d1e-b6b2-a875433f76c4 req-b8d22190-37a3-4d5c-bcec-a04534b35089 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040792 Apr 20 13:25:29 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 59/174] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:29 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:25:29 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:29 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-0586dca8-b55f-438d-b42f-94a33435e87b tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968" status: 200 len: 1503 microversion: 2.1 time: 0.244456 Apr 20 13:25:29 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 61/175] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:29 2023] GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 => generated 1503 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "name": "network-vif-plugged", "status": "completed", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:31 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] Creating event network-vif-plugged:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:25:31 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-a93ac5d4-5cee-44a6-908f-e63614a29691 req-6a617ed6-c8f7-49c0-94cb-86f10e678e8c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034061 Apr 20 13:25:31 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 60/176] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:33 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "name": "network-vif-plugged", "status": "completed", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:33 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:33 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:33 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:33 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] Creating event network-vif-plugged:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:25:33 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-13421377-e107-407c-8087-bc36d07f6066 req-1c569f03-2020-42e8-b4d2-2170dfc28c0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038875 Apr 20 13:25:33 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 62/177] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:35 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:35 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:35 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:35 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:37 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404bd455b1834e68b508de3f651146d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d7672015e428e807dcb7e0fb58f60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:37 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-39029c11-30d2-405e-9da5-59b7110e1c8c tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c" status: 200 len: 1487 microversion: 2.1 time: 0.211603 Apr 20 13:25:37 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 61/178] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:37 2023] GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c => generated 1487 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=10 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:41 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:41 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-269931cf-8793-496c-828c-830b647afa02 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.234542 Apr 20 13:25:41 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 63/179] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:41 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:42 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882cab9c92ed4bfa8682a25169a49d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5d76af78b94668a18adcddc22a8440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9594b536-a62e-4f34-b664-722d060e93c5 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 200 len: 1672 microversion: 2.1 time: 0.229176 Apr 20 13:25:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 62/180] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:42 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 1672 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-7a7a8896-0f83-4ed7-ba85-345192d4c9c5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 18.501471 Apr 20 13:25:43 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 56/181] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:25:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 18503 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:25:43 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8f25d85f-5016-4d31-be13-620f759a889f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:43 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8f25d85f-5016-4d31-be13-620f759a889f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:43 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-8f25d85f-5016-4d31-be13-620f759a889f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:43 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-8f25d85f-5016-4d31-be13-620f759a889f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 200 len: 1236 microversion: 2.1 time: 0.079288 Apr 20 13:25:43 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 64/182] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:43 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 1236 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5cc836b0-63c9-457c-8a1c-6bbc45554903 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '.version_select at 0x7f31d912bc70>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-5cc836b0-63c9-457c-8a1c-6bbc45554903 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95" status: 204 len: 0 microversion: 2.1 time: 0.230247 Apr 20 13:25:44 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 63/183] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:44 2023] DELETE /compute/v2.1/images/2b06767e-5313-4def-ad28-ee0352684b95 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:44 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:25:44 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-ae5493f4-2f50-4a94-af23-9e791905ebde tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 204 len: 0 microversion: 2.1 time: 0.110454 Apr 20 13:25:44 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 57/184] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:25:44 2023] DELETE /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:44 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '882cab9c92ed4bfa8682a25169a49d9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d5d76af78b94668a18adcddc22a8440', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-c8bd441c-d973-42d6-978c-504575a28d0d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 200 len: 1678 microversion: 2.1 time: 0.325907 Apr 20 13:25:44 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 65/185] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:44 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 1678 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "name": "network-vif-unplugged", "status": "completed", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] Creating event network-vif-unplugged:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:25:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-2b1a8169-f7a4-4a14-a92c-d65f40623d9e req-ea896b54-ad93-47ac-94b7-af0d94cb1f3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072755 Apr 20 13:25:44 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 64/186] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:44 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:46 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] Creating event network-changed:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:25:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-4ee40470-6301-4e00-9ca4-9f5bec3f1de6 req-4486e063-fdc7-4e6b-85ef-46aa03ddbc59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039098 Apr 20 13:25:46 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 58/187] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:46 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "name": "network-vif-plugged", "status": "completed", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}, {"server_uuid": "f7f7844b-b316-4af0-b40d-13b8d0ec29d6", "name": "network-vif-deleted", "tag": "a36f5d71-7da8-44cf-a09f-de30258435f6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:46 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:46 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:46 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Creating event network-vif-plugged:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:25:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] Creating event network-vif-deleted:a36f5d71-7da8-44cf-a09f-de30258435f6 for instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 on user Apr 20 13:25:46 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-54430da4-ac99-4304-874a-20c9d26b5f17 req-c1bb5f63-2e52-4b83-8074-baf351092278 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036523 Apr 20 13:25:46 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 66/188] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:46 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:48 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "name": "network-vif-plugged", "status": "completed", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] Creating event network-vif-plugged:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:25:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-87df761e-fd6d-4ae7-9eef-a7bf5956ff84 req-004b7b3f-f16d-4465-86ef-4b1731cf028c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040611 Apr 20 13:25:48 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 65/189] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:25:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "name": "network-vif-plugged", "status": "completed", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] Creating event network-vif-plugged:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:25:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-04013d58-6465-4c41-8e31-f138f090c3d9 req-a00925a8-9dc5-47ab-9068-77d4867746b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031683 Apr 20 13:25:50 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 59/190] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=25 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:54 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:25:54 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-28050025-179c-438b-8264-082a19b3383a tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868" status: 204 len: 0 microversion: 2.1 time: 0.268950 Apr 20 13:25:54 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 67/191] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:25:54 2023] DELETE /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=23 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:25:54 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "name": "network-vif-unplugged", "status": "completed", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:54 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:54 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:25:54 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] Creating event network-vif-unplugged:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:25:54 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-dad73c15-a44d-49c3-b392-7f7419295049 req-ac2136a8-b9c8-474a-9e37-f1ac9d637a24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031657 Apr 20 13:25:54 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 60/192] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:25:54 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-543aa239-c6de-4b69-84bf-6320d65cacf9 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868" status: 200 len: 1501 microversion: 2.1 time: 0.389297 Apr 20 13:25:54 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 66/193] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:25:54 2023] GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 => generated 1501 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:25:56 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "name": "network-vif-plugged", "status": "completed", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}, {"server_uuid": "ec51422f-aef5-4653-962a-bf0fba7c5868", "name": "network-vif-deleted", "tag": "61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:25:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:25:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:25:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:25:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Creating event network-vif-plugged:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:25:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] Creating event network-vif-deleted:61e1d080-c9b6-4aca-8deb-5b9e4e4aea2a for instance ec51422f-aef5-4653-962a-bf0fba7c5868 on user Apr 20 13:25:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-21e69127-1702-477d-acd1-de1dbfb18974 req-ddec241b-bd62-4131-89ac-cf6d5726db41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031732 Apr 20 13:25:56 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 68/194] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:25:56 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:16 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:16 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-0bae956c-eeba-4342-8441-8d942056065b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 200 len: 1538 microversion: 2.1 time: 0.255090 Apr 20 13:26:16 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 61/195] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:16 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 1538 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=5 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:32 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:26:32 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4009a0dd-c76f-4caf-aa4c-499df81c68d7 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 204 len: 0 microversion: 2.1 time: 0.131362 Apr 20 13:26:32 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 67/196] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:26:32 2023] DELETE /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-unplugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] Creating event network-vif-unplugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:26:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-ec57590c-11b7-4121-8d74-87feec783bd8 req-cdc57324-1d73-4b53-a50f-f3b0f67fe06c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032489 Apr 20 13:26:32 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 62/197] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-af9a2dc6-60b3-4ca2-b3b2-9d95b6d7f540 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 200 len: 1496 microversion: 2.1 time: 0.276587 Apr 20 13:26:32 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 69/198] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:32 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 1496 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:33 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:33 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-7a4572dd-3e95-45d3-bbdc-92f20b1e8772 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 200 len: 1545 microversion: 2.1 time: 0.217143 Apr 20 13:26:33 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 68/199] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:33 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 1545 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:34 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-plugged", "status": "completed", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}, {"server_uuid": "b217e938-1848-4803-900b-df6c8f0ed355", "name": "network-vif-deleted", "tag": "486e9f2f-1e26-4efe-84d0-a615eeec0849"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:34 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Creating event network-vif-plugged:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:26:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] Creating event network-vif-deleted:486e9f2f-1e26-4efe-84d0-a615eeec0849 for instance b217e938-1848-4803-900b-df6c8f0ed355 on user Apr 20 13:26:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-f0e351ae-61af-4775-a7ec-8841625c3fcb req-d5aca3be-d021-4f3b-aac0-9ec925f2d5dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037083 Apr 20 13:26:34 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 63/200] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] [instance: f7f7844b-b316-4af0-b40d-13b8d0ec29d6] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:34 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] HTTP exception thrown: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Request method failure captured: Apr 20 13:26:34 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 HTTP/1.1 Apr 20 13:26:34 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:26:34 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:26:34 user devstack@n-api.service[61277]: Connection: close Apr 20 13:26:34 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:26:34 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:26:34 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:26:34 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:26:34 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxrq8t5WfjPaiMGOEJJrlaX5SczzMzhXLrkSXSYlQaF5k7BdLSqvA0Xe79v2NjuJRKmHzBQh0OP8-8QWRayjFeP5YfZx1GdfJo8ddzfNKhPjR0CCUiS7kSxvNe-0O2cNXHc6GgNRreJEybLAiUkd4xhJdQzFaTPMCAicHesNBMEpsQ Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Project-Id: 5d5d76af78b94668a18adcddc22a8440 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1000583685 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d5d76af78b94668a18adcddc22a8440"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5d5d76af78b94668a18adcddc22a8440"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5d5d76af78b94668a18adcddc22a8440"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Tenant: tempest-ServerStableDeviceRescueTest-1000583685 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Tenant-Id: 5d5d76af78b94668a18adcddc22a8440 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1000583685 Apr 20 13:26:34 user devstack@n-api.service[61277]: X-User: tempest-ServerStableDeviceRescueTest-1000583685-project-member Apr 20 13:26:34 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:26:34 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:26:34 user devstack@n-api.service[61277]: X-User-Id: 882cab9c92ed4bfa8682a25169a49d9b Apr 20 13:26:34 user devstack@n-api.service[61277]: X-User-Name: tempest-ServerStableDeviceRescueTest-1000583685-project-member Apr 20 13:26:34 user devstack@n-api.service[61277]: method: > Apr 20 13:26:34 user devstack@n-api.service[61277]: exception: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. Apr 20 13:26:34 user devstack@n-api.service[61277]: action_args: {'id': 'f7f7844b-b316-4af0-b40d-13b8d0ec29d6'} Apr 20 13:26:34 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. Apr 20 13:26:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Returning 404 to user: Instance f7f7844b-b316-4af0-b40d-13b8d0ec29d6 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:26:34 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ace932a4-d7ae-4b9e-abf3-aced0209a35d tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6" status: 404 len: 111 microversion: 2.1 time: 0.035553 Apr 20 13:26:34 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 70/201] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:34 2023] GET /compute/v2.1/servers/f7f7844b-b316-4af0-b40d-13b8d0ec29d6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:26:34 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-b887261a-8805-479c-9770-7b8432bb5b99 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] Calling method '.version_select at 0x7f31d912a0e0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:34 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-b887261a-8805-479c-9770-7b8432bb5b99 tempest-ServerStableDeviceRescueTest-1000583685 tempest-ServerStableDeviceRescueTest-1000583685-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028024611" status: 202 len: 0 microversion: 2.1 time: 0.023390 Apr 20 13:26:34 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 69/202] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 13:26:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1028024611 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:39 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:26:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-11ff8d22-05b9-47b5-ad6d-a6e379d96656 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c" status: 204 len: 0 microversion: 2.1 time: 0.113962 Apr 20 13:26:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 64/203] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:26:39 2023] DELETE /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:39 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "name": "network-vif-unplugged", "status": "completed", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:39 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '404bd455b1834e68b508de3f651146d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c8d7672015e428e807dcb7e0fb58f60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:39 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:39 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-51f752a6-4749-4a84-b50b-f878821f77d3 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c" status: 200 len: 1493 microversion: 2.1 time: 0.338282 Apr 20 13:26:39 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 71/204] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:39 2023] GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c => generated 1493 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:39 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] Creating event network-vif-unplugged:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:26:39 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-bc28ffc0-6944-423f-a60c-b1c305f47a32 req-774c2543-d60d-43c8-87aa-03ca18b71669 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032727 Apr 20 13:26:39 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 70/205] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:39 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:41 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "name": "network-vif-deleted", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] Creating event network-vif-deleted:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:26:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-ccfcd6a4-1518-417f-bfa8-48ae3e458129 req-f3bb9888-bbc3-46c2-9896-a3786a74aada service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030500 Apr 20 13:26:41 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 65/206] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f778634c-45c2-4284-ad3b-0529810fa77c", "name": "network-vif-plugged", "status": "completed", "tag": "09c6e4cd-9b64-4aff-9faa-fe69856acc18"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] Creating event network-vif-plugged:09c6e4cd-9b64-4aff-9faa-fe69856acc18 for instance f778634c-45c2-4284-ad3b-0529810fa77c on user Apr 20 13:26:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-d3664fd9-fc3a-475d-ba37-7a1ee04d1b25 req-5a3546ec-1a8d-4b4b-951c-c7216c6f1045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030244 Apr 20 13:26:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 71/207] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:42 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:42 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f5900edd-f4c6-48e1-add1-ce82605e7fb9 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.261821 Apr 20 13:26:42 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 72/208] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:41 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:42 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-98b8dcbe-e66c-4220-a12d-15ef96a006a8 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.370543 Apr 20 13:26:42 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 66/209] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:42 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:42 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-24e1285b-18ba-44d0-9ab0-d8049dfd2a10 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.219297 Apr 20 13:26:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 72/210] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:42 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: ec51422f-aef5-4653-962a-bf0fba7c5868] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] HTTP exception thrown: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Request method failure captured: Apr 20 13:26:44 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 HTTP/1.1 Apr 20 13:26:44 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:26:44 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:26:44 user devstack@n-api.service[61277]: Connection: close Apr 20 13:26:44 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:26:44 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:26:44 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:26:44 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:26:44 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxgR7VD7oMc_7PVRePxw-UD784QYLn0m4x3xge5qD1EdFNq5WiHO9jiq5DcTe_LQGewFQohWWQe2K5zX01mrSTj-bV0171wQJWRym1uerPTJmHhHGG6NEtzYAwzK2jnla-uRYFQu1LLuNyLyDt67B_nekvG261G_Y_1biCTxiLxNXA Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Project-Id: 973f328b0e474229a74744dee1f17f89 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973f328b0e474229a74744dee1f17f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973f328b0e474229a74744dee1f17f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/973f328b0e474229a74744dee1f17f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Tenant-Id: 973f328b0e474229a74744dee1f17f89 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-User: tempest-VolumesAdminNegativeTest-742981342-project-member Apr 20 13:26:44 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:26:44 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:26:44 user devstack@n-api.service[61277]: X-User-Id: 9803a74b170d457c9cb6c4b1e5ff2e63 Apr 20 13:26:44 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesAdminNegativeTest-742981342-project-member Apr 20 13:26:44 user devstack@n-api.service[61277]: method: > Apr 20 13:26:44 user devstack@n-api.service[61277]: exception: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. Apr 20 13:26:44 user devstack@n-api.service[61277]: action_args: {'id': 'ec51422f-aef5-4653-962a-bf0fba7c5868'} Apr 20 13:26:44 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. Apr 20 13:26:44 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:26:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Returning 404 to user: Instance ec51422f-aef5-4653-962a-bf0fba7c5868 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:26:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-020df24b-0a36-4fb5-b9c7-c28de148f1df tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868" status: 404 len: 111 microversion: 2.1 time: 0.028500 Apr 20 13:26:44 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 73/211] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:44 2023] GET /compute/v2.1/servers/ec51422f-aef5-4653-962a-bf0fba7c5868 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:44 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:26:45 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-13b32d94-a50c-47c7-8537-7e4cda774bd4 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496" status: 204 len: 0 microversion: 2.1 time: 0.149447 Apr 20 13:26:45 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 67/212] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:26:44 2023] DELETE /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:45 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9803a74b170d457c9cb6c4b1e5ff2e63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '973f328b0e474229a74744dee1f17f89', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:45 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-b3202747-d513-4ea4-a4d2-02c3647a2377 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496" status: 200 len: 1669 microversion: 2.1 time: 0.346623 Apr 20 13:26:45 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:26:45 2023] GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 => generated 1669 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:26:45 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "name": "network-vif-unplugged", "status": "completed", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:45 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] Creating event network-vif-unplugged:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:26:45 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-1a588b4f-68a3-4674-97c2-4260d3542846 req-e1a97ba5-975b-4aaf-bed2-635dce6bc9fb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036616 Apr 20 13:26:45 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 74/214] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:47 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "name": "network-vif-plugged", "status": "completed", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}, {"server_uuid": "8a9e917c-b4a3-4058-96fe-6fe1b3ec7496", "name": "network-vif-deleted", "tag": "6da0294a-95b3-45a2-a705-0236d0b0b6eb"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:47 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Creating event network-vif-plugged:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:26:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] Creating event network-vif-deleted:6da0294a-95b3-45a2-a705-0236d0b0b6eb for instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 on user Apr 20 13:26:47 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-6c3aefd8-0735-4251-b05a-9bbaeefae35e req-6a430d48-9cad-4e70-9f2c-969ef6bf2dc6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031590 Apr 20 13:26:47 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 68/215] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:47 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-43db0b75-4ea2-4016-8358-d0e8dda7ea07 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Action: 'create', calling method: .version_select at 0x7f31d912b250>, body: {"keypair": {"name": "tempest-keypair-1878814337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNE9CihS7zo235RX1iCl28NXVTjOVbK/R7Xo8D/yQhKVG7jxEO7fAipxHP5bytAJI+sBfop/9nU2rHh/BVhv+FFDmHkwrA7hdthjwWdF65Jhb/G0sMhNyxHDCCksdOf7Hg=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:47 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-43db0b75-4ea2-4016-8358-d0e8dda7ea07 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:26:47 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-43db0b75-4ea2-4016-8358-d0e8dda7ea07 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for user 52b0f0cdb4f34677bd872c372099348e and project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:26:47 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-43db0b75-4ea2-4016-8358-d0e8dda7ea07 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.113220 Apr 20 13:26:47 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 74/216] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 13:26:47 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 13:26:49 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-922384245", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7a857017-af57-4923-870a-2b021087802c"}], "security_groups": [{"name": "tempest-securitygroup--865381656"}], "key_name": "tempest-keypair-1878814337", "user_data": "}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:49 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] validate_networks() for [('7a857017-af57-4923-870a-2b021087802c', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for user 52b0f0cdb4f34677bd872c372099348e and project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:26:50 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:26:50 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-20541bac-8384-4ed0-80e8-814c70ed5b82 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.749964 Apr 20 13:26:50 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 75/217] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:26:49 2023] POST /compute/v2.1/servers => generated 399 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:26:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:26:50 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:26:50 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:50 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:50 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:26:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-39eaacd0-add4-4b88-aa7d-76b12024823d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 200 len: 1275 microversion: 2.20 time: 0.073873 Apr 20 13:26:50 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 69/218] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:26:50 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 1275 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:26:52 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] Creating event network-changed:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:26:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-02fa9ca1-48cc-4725-ab75-afb2084098bb req-d3a5473c-033e-4567-8b1e-88020990efc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032035 Apr 20 13:26:52 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 75/219] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:55 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "name": "network-vif-plugged", "status": "completed", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:55 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:55 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:55 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:55 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] Creating event network-vif-plugged:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:26:55 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-15a075f5-04c6-4d51-82da-9b4c377da063 req-080a4a3d-960b-457f-998c-ac637239a045 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095928 Apr 20 13:26:55 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 76/220] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:26:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "name": "network-vif-plugged", "status": "completed", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:26:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:26:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:26:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:26:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] Creating event network-vif-plugged:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:26:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-31b14859-cb31-47c9-8231-c095bf3dcd6b req-fa8a74e1-81bb-4073-a068-cec41cd71254 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030188 Apr 20 13:26:57 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 70/221] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:26:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:16 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:16 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-1b7c5ca1-9607-4e2a-8df3-f34ea609063c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.280695 Apr 20 13:27:16 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 76/222] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:27:16 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe/os-interface => generated 282 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=28 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:17 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:17 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:17 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-31949c2c-308f-4903-ac0f-41e195ea5a23 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe/ips" status: 200 len: 104 microversion: 2.1 time: 0.050427 Apr 20 13:27:17 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 71/223] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:27:17 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe/ips => generated 104 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:17 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] Creating event network-changed:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:27:17 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-9e82f909-a7d1-4535-bbfb-27b8bd14d694 req-43646081-7897-4a44-9e2c-0222f14cc5e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164407 Apr 20 13:27:17 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 77/224] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:19 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:27:19 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-3ba679f7-f02d-4b97-917e-fc8512d2d4c5 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 204 len: 0 microversion: 2.1 time: 0.153130 Apr 20 13:27:19 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 77/225] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:27:19 2023] DELETE /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:19 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:19 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-c9e4b6a9-7181-4498-939e-19b4fc3650f7 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 200 len: 1663 microversion: 2.1 time: 0.331364 Apr 20 13:27:19 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 72/226] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:19 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 1663 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:27:19 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "name": "network-vif-unplugged", "status": "completed", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}, {"server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "name": "network-vif-plugged", "status": "completed", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:19 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Creating event network-vif-unplugged:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:27:19 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] Creating event network-vif-plugged:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:27:19 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-4cf293e5-0be6-41d0-b689-77a7f8bab071 req-8fdf4a99-421f-4a8d-9583-5929cc1cb468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.040016 Apr 20 13:27:19 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 78/227] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:19 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:20 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe", "name": "network-vif-deleted", "tag": "0b52317d-b5d5-482c-88fc-4291f3f907b4"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:20 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:20 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:20 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:20 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] Creating event network-vif-deleted:0b52317d-b5d5-482c-88fc-4291f3f907b4 for instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe on user Apr 20 13:27:20 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-2c224f09-96a6-4e19-aaff-399a7194e9fb req-2ef04e98-1d9b-4c76-82f5-236a07aa8813 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041846 Apr 20 13:27:20 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 78/228] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: b217e938-1848-4803-900b-df6c8f0ed355] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] HTTP exception thrown: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Request method failure captured: Apr 20 13:27:22 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 HTTP/1.1 Apr 20 13:27:22 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:27:22 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:27:22 user devstack@n-api.service[61279]: Connection: close Apr 20 13:27:22 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:27:22 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:27:22 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:27:22 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:27:22 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTxlbsvyu5uSKHIOkXr1jf40JCkA1rOrmX2lvn85Ch5SWnuEzx63AcC46kgx4EVz_xZChvcfNk2Mz7v2x5Uz3pI2K1kfgy7G8Wo9qOu8MwAooh_AWyIb1apbh4lH26IOewMBwreweoOzJN3JJpLXMHamcOPvQPktYPUDa3sVqY3qrwo Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Project-Id: 4a526e5a9ffe4ec6a153bb0bc218913e Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Tenant: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Tenant-Id: 4a526e5a9ffe4ec6a153bb0bc218913e Apr 20 13:27:22 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:27:22 user devstack@n-api.service[61279]: X-User: tempest-ServerRescueNegativeTestJSON-616842808-project-member Apr 20 13:27:22 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:27:22 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:27:22 user devstack@n-api.service[61279]: X-User-Id: c7e63be0504a4fcca19c8b86d95c699d Apr 20 13:27:22 user devstack@n-api.service[61279]: X-User-Name: tempest-ServerRescueNegativeTestJSON-616842808-project-member Apr 20 13:27:22 user devstack@n-api.service[61279]: method: > Apr 20 13:27:22 user devstack@n-api.service[61279]: exception: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. Apr 20 13:27:22 user devstack@n-api.service[61279]: action_args: {'id': 'b217e938-1848-4803-900b-df6c8f0ed355'} Apr 20 13:27:22 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. Apr 20 13:27:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Returning 404 to user: Instance b217e938-1848-4803-900b-df6c8f0ed355 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:27:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-f2fa6e9a-8cab-4047-b87c-b5af92c03a43 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355" status: 404 len: 111 microversion: 2.1 time: 0.131691 Apr 20 13:27:22 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 73/229] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:22 2023] GET /compute/v2.1/servers/b217e938-1848-4803-900b-df6c8f0ed355 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:22 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:27:23 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-e3bd3f03-c69f-4629-9d65-9ce212debbda tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968" status: 204 len: 0 microversion: 2.1 time: 0.154407 Apr 20 13:27:23 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 79/230] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:27:22 2023] DELETE /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:23 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e63be0504a4fcca19c8b86d95c699d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a526e5a9ffe4ec6a153bb0bc218913e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:23 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-40afe2f0-2525-450e-ad65-5410abc1d3ff tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968" status: 200 len: 1509 microversion: 2.1 time: 0.238449 Apr 20 13:27:23 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 79/231] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:23 2023] GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 => generated 1509 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:27:23 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "name": "network-vif-unplugged", "status": "completed", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] Creating event network-vif-unplugged:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:27:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-9a74f83d-4681-45cf-a4dd-1c5c399a8a40 req-2f3a4b57-e134-43f2-afc0-21f05324868d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082945 Apr 20 13:27:23 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 74/232] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:24 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "name": "network-vif-deleted", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] Creating event network-vif-deleted:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:27:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-d349b2bd-9b87-4868-b8b5-bcc86638ddd9 req-dd2a9494-121b-4852-9b59-48a90a21b352 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029314 Apr 20 13:27:24 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 80/233] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:25 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc90d45-d514-417c-81fa-a96c4a704968", "name": "network-vif-plugged", "status": "completed", "tag": "10ad43cc-c79a-4090-b546-b8e20a882417"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:25 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:25 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:25 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:25 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] Creating event network-vif-plugged:10ad43cc-c79a-4090-b546-b8e20a882417 for instance 4cc90d45-d514-417c-81fa-a96c4a704968 on user Apr 20 13:27:25 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-15370514-0b05-4de5-a672-31fc72fafa23 req-6aaf83e6-e26d-4f90-b2f9-c305f210038e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028356 Apr 20 13:27:25 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 80/234] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] [instance: f778634c-45c2-4284-ad3b-0529810fa77c] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:30 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] HTTP exception thrown: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Request method failure captured: Apr 20 13:27:30 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c HTTP/1.1 Apr 20 13:27:30 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:27:30 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:27:30 user devstack@n-api.service[61279]: Connection: close Apr 20 13:27:30 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:27:30 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:27:30 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:27:30 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:27:30 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT0dj8jF4h0BBpB7uXCWzMBF-ttOUlXqZ2BLlGiJ-1U_xW26oBikl3oLpROxUoH-PH9f2QXTNVkbZtfXAzMQLQxv0dtnw26F9MnKaNaAoEdwAgQQPWfsKlyRmRVtjk_1B2oHEeae4t5Xt7MrUduS5dkKyAIJ-W_V7uj-MZNmGqMaLYw Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Project-Id: 2c8d7672015e428e807dcb7e0fb58f60 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Project-Name: tempest-VolumesActionsTest-264200941 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c8d7672015e428e807dcb7e0fb58f60"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/2c8d7672015e428e807dcb7e0fb58f60"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/2c8d7672015e428e807dcb7e0fb58f60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Tenant: tempest-VolumesActionsTest-264200941 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Tenant-Id: 2c8d7672015e428e807dcb7e0fb58f60 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-VolumesActionsTest-264200941 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-User: tempest-VolumesActionsTest-264200941-project-member Apr 20 13:27:30 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:27:30 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:27:30 user devstack@n-api.service[61279]: X-User-Id: 404bd455b1834e68b508de3f651146d5 Apr 20 13:27:30 user devstack@n-api.service[61279]: X-User-Name: tempest-VolumesActionsTest-264200941-project-member Apr 20 13:27:30 user devstack@n-api.service[61279]: method: > Apr 20 13:27:30 user devstack@n-api.service[61279]: exception: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. Apr 20 13:27:30 user devstack@n-api.service[61279]: action_args: {'id': 'f778634c-45c2-4284-ad3b-0529810fa77c'} Apr 20 13:27:30 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. Apr 20 13:27:30 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:27:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] Returning 404 to user: Instance f778634c-45c2-4284-ad3b-0529810fa77c could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:27:30 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-caa73759-cb06-4955-a385-c55fe775f989 tempest-VolumesActionsTest-264200941 tempest-VolumesActionsTest-264200941-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c" status: 404 len: 111 microversion: 2.1 time: 0.027402 Apr 20 13:27:30 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 75/235] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:30 2023] GET /compute/v2.1/servers/f778634c-45c2-4284-ad3b-0529810fa77c => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:34 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-66eccf46-6604-4aec-911c-76d6f1f1c38f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.170223 Apr 20 13:27:34 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 81/236] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:27:34 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383/os-interface => generated 282 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:34 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:35 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:35 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:35 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:35 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] Creating event network-changed:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:27:35 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-3ce475f9-8f94-4303-b2ea-02f41ff15355 req-04df4139-0699-48e2-ad3b-212b0543e2b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037244 Apr 20 13:27:35 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 81/237] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:35 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-885e2cc8-1574-41a6-8ce0-dac5eb1484d4 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383/ips" status: 200 len: 107 microversion: 2.1 time: 0.034940 Apr 20 13:27:35 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 76/238] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:27:35 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383/ips => generated 107 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] [instance: 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:35 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] HTTP exception thrown: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Request method failure captured: Apr 20 13:27:35 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 HTTP/1.1 Apr 20 13:27:35 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:27:35 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:27:35 user devstack@n-api.service[61277]: Connection: close Apr 20 13:27:35 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:27:35 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:27:35 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:27:35 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:27:35 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxgR7VD7oMc_7PVRePxw-UD784QYLn0m4x3xge5qD1EdFNq5WiHO9jiq5DcTe_LQGewFQohWWQe2K5zX01mrSTj-bV0171wQJWRym1uerPTJmHhHGG6NEtzYAwzK2jnla-uRYFQu1LLuNyLyDt67B_nekvG261G_Y_1biCTxiLxNXA Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Project-Id: 973f328b0e474229a74744dee1f17f89 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973f328b0e474229a74744dee1f17f89"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/973f328b0e474229a74744dee1f17f89"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/973f328b0e474229a74744dee1f17f89"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Tenant-Id: 973f328b0e474229a74744dee1f17f89 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-742981342 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-User: tempest-VolumesAdminNegativeTest-742981342-project-member Apr 20 13:27:35 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:27:35 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:27:35 user devstack@n-api.service[61277]: X-User-Id: 9803a74b170d457c9cb6c4b1e5ff2e63 Apr 20 13:27:35 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesAdminNegativeTest-742981342-project-member Apr 20 13:27:35 user devstack@n-api.service[61277]: method: > Apr 20 13:27:35 user devstack@n-api.service[61277]: exception: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. Apr 20 13:27:35 user devstack@n-api.service[61277]: action_args: {'id': '8a9e917c-b4a3-4058-96fe-6fe1b3ec7496'} Apr 20 13:27:35 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. Apr 20 13:27:35 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:27:35 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Returning 404 to user: Instance 8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:27:35 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-d650845e-a467-482e-86e9-42605ef4bd77 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496" status: 404 len: 111 microversion: 2.1 time: 0.134003 Apr 20 13:27:35 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 82/239] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:35 2023] GET /compute/v2.1/servers/8a9e917c-b4a3-4058-96fe-6fe1b3ec7496 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:27:35 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4be0c235-a9f1-467a-8046-a24a3de00826 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] Calling method '.version_select at 0x7f31d912b760>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:35 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4be0c235-a9f1-467a-8046-a24a3de00826 tempest-VolumesAdminNegativeTest-742981342 tempest-VolumesAdminNegativeTest-742981342-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-18511535" status: 202 len: 0 microversion: 2.1 time: 0.022797 Apr 20 13:27:35 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 82/240] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 13:27:35 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-18511535 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:36 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:27:36 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-3d57d00a-a11e-4d55-a827-6d13663ad28f tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 204 len: 0 microversion: 2.1 time: 0.112154 Apr 20 13:27:36 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 77/241] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:27:36 2023] DELETE /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:36 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-e15bf0c2-f3be-401e-8102-1bdeaf8aefcb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 200 len: 1670 microversion: 2.1 time: 0.190514 Apr 20 13:27:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 83/242] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:36 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 1670 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:27:37 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "name": "network-vif-unplugged", "status": "completed", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:37 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] Creating event network-vif-unplugged:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:27:37 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-c190b8b8-06df-4acd-af39-50e6a2ba8191 req-8bd0660c-c5db-4cf5-a4a7-6b0bf817512d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035652 Apr 20 13:27:37 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 83/243] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "name": "network-vif-plugged", "status": "completed", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}, {"server_uuid": "749ad860-afb9-48e8-98d3-761700ee6383", "name": "network-vif-deleted", "tag": "ce1ac7fd-b942-40ac-9ede-27842a6a6610"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Creating event network-vif-plugged:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:27:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] Creating event network-vif-deleted:ce1ac7fd-b942-40ac-9ede-27842a6a6610 for instance 749ad860-afb9-48e8-98d3-761700ee6383 on user Apr 20 13:27:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-b4db7e6a-4eb3-4b39-8854-bb9938ef9acc req-32a408f5-b305-4a30-8748-33357c0a364e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040736 Apr 20 13:27:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 78/244] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-12bf3586-2339-4728-834d-0cc3939c2f26 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 200 len: 1586 microversion: 2.20 time: 0.333528 Apr 20 13:27:40 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 84/245] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:27:40 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 1586 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:44 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-88e89e92-646f-4b98-9890-0d1a8792a1e0 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.369712 Apr 20 13:27:44 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 84/246] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:27:44 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:27:50 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:50 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1071520056", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "eae33ff8-4b9e-47ed-ae38-92bbb5103d34"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:50 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] validate_networks() for [('eae33ff8-4b9e-47ed-ae38-92bbb5103d34', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for user c3692be8cf1e4aaca3064315bd58925d and project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:27:51 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:27:51 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-5fda5866-9471-41fc-b081-7f1d19be85c5 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.818907 Apr 20 13:27:51 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 79/247] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:27:50 2023] POST /compute/v2.1/servers => generated 378 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:51 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:27:51 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-a4577370-a4ec-40b3-990e-8a734b1472b4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 200 len: 1395 microversion: 2.87 time: 0.099499 Apr 20 13:27:51 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 85/248] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:27:51 2023] GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 1395 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:55 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:55 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] Creating event network-changed:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:27:55 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-ed698cf3-6447-40ab-a01f-cff6e79b9bed req-160779b0-2f18-449b-83b6-05851fa1ff0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037328 Apr 20 13:27:55 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 85/249] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "name": "network-vif-plugged", "status": "completed", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] Creating event network-vif-plugged:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:27:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-bdac9c56-a4d2-4a16-ba72-508f801b178b req-d79f9aba-2b9d-4fac-ab97-c5ded91e4cdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036765 Apr 20 13:27:57 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 80/250] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:27:59 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "name": "network-vif-plugged", "status": "completed", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:27:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:27:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:27:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:27:59 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] Creating event network-vif-plugged:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:27:59 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-35ba7597-e620-4817-a919-e802ed965e42 req-0e162a6e-5e62-4ca1-a971-6ed65940608c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028399 Apr 20 13:27:59 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 86/251] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:27:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-46255ac9-fd5d-4c58-87b5-1b6f9803e05e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Action: 'create', calling method: .version_select at 0x7f31d9d89cf0>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1506709410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyMzVMtm5LuJxc06dRKTOSntJGIqnjI77Q/tmIdyiGbX/2bpofawe9l7qCR8VmbKSGYNxJlIZNP8ZGsH6xLxdYzvzeFjHRqoI/ovtU3Vow/13h3vGEaycvgeFBPQ1j9+w=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:03 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-46255ac9-fd5d-4c58-87b5-1b6f9803e05e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Getting quotas for project f9130c8724534f37802e04fb58034fdb. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:03 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-46255ac9-fd5d-4c58-87b5-1b6f9803e05e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Getting quotas for user 54c1be4f770c4bc386f125d3bbea0f1b and project f9130c8724534f37802e04fb58034fdb. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-46255ac9-fd5d-4c58-87b5-1b6f9803e05e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.273672 Apr 20 13:28:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 86/252] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:28:03 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-861235796", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1506709410", "security_groups": [{"name": "tempest-secgroup-smoke-1375277651"}], "networks": [{"uuid": "61a64ddb-c29d-4ba5-8d0a-dec0943be5ed"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] validate_networks() for [('61a64ddb-c29d-4ba5-8d0a-dec0943be5ed', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Getting quotas for project f9130c8724534f37802e04fb58034fdb. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Getting quotas for user 54c1be4f770c4bc386f125d3bbea0f1b and project f9130c8724534f37802e04fb58034fdb. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:28:05 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:28:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-4e15a50b-8f79-44c2-8efc-edbe7c168e3d tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.654088 Apr 20 13:28:06 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 81/253] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:28:05 2023] POST /compute/v2.1/servers => generated 404 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:28:06 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-545343da-d69f-4032-9c83-770d4268a7ae tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:06 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-545343da-d69f-4032-9c83-770d4268a7ae tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:06 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:06 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-545343da-d69f-4032-9c83-770d4268a7ae tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1be4f770c4bc386f125d3bbea0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9130c8724534f37802e04fb58034fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:06 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-545343da-d69f-4032-9c83-770d4268a7ae tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 200 len: 1256 microversion: 2.1 time: 0.080738 Apr 20 13:28:06 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 87/254] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:06 2023] GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 1256 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:08 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:08 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:08 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] Creating event network-changed:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:28:08 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-877e3098-7be5-470b-b9e6-04f6d82f1350 req-a87220c6-16cc-48b6-a2b1-d3c30e0af5f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033102 Apr 20 13:28:08 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 87/255] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:28:09 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe HTTP/1.1 Apr 20 13:28:09 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:28:09 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:28:09 user devstack@n-api.service[61279]: Connection: close Apr 20 13:28:09 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:28:09 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:28:09 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:28:09 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:28:09 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:28:09 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:28:09 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:28:09 user devstack@n-api.service[61279]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:28:09 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:28:09 user devstack@n-api.service[61279]: method: > Apr 20 13:28:09 user devstack@n-api.service[61279]: exception: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:28:09 user devstack@n-api.service[61279]: action_args: {'id': '93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe'} Apr 20 13:28:09 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:28:09 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:09 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:28:09 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-969882d2-8f51-4b4e-bbc7-753670d2576c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 404 len: 111 microversion: 2.1 time: 0.032482 Apr 20 13:28:09 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 82/256] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:09 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:28:09 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-af4ea8a0-6dec-49f5-ba4a-a896fc2c25d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '.version_select at 0x7f31d91679a0>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:09 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:09 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-af4ea8a0-6dec-49f5-ba4a-a896fc2c25d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047423207" status: 202 len: 0 microversion: 2.1 time: 0.040509 Apr 20 13:28:09 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 88/257] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 13:28:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2047423207 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:28:10 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a94f7d86-5ebd-4db2-9c62-c93f38125f4b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Action: 'create', calling method: .version_select at 0x7f31d9337370>, body: {"keypair": {"name": "tempest-keypair-61642113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHYMF1puHnxU5Fej7Hmb+ATMKJP7TAJnh+b6m0r+VglgOQf6jfJx5KcyoHjh44hQyziM0ntRovMp21ViQye7X5yZEvEWL5ZUYpgdu7uVkyjUB9alr+7bkaYJtv+LT4pEzA=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:10 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-a94f7d86-5ebd-4db2-9c62-c93f38125f4b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for project e70d7b30abc14fcab2ffb23660891757. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:10 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-a94f7d86-5ebd-4db2-9c62-c93f38125f4b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for user d10d3929c7314a639db592a13ffca375 and project e70d7b30abc14fcab2ffb23660891757. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:10 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a94f7d86-5ebd-4db2-9c62-c93f38125f4b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046781 Apr 20 13:28:10 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 88/258] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:28:10 2023] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:11 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-plugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:11 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:11 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:11 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:11 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] Creating event network-vif-plugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:28:11 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-e2ffb771-7e52-4241-8eb1-b29df060761b req-816b60eb-efe5-4afa-85dd-bb4fd408dee7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039740 Apr 20 13:28:11 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 83/259] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1604161811", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c12dfbdc-6f7e-4ec1-a667-d1ba4e061da3"}], "security_groups": [{"name": "tempest-securitygroup--516920614"}], "key_name": "tempest-keypair-61642113", "user_data": "}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] validate_networks() for [('c12dfbdc-6f7e-4ec1-a667-d1ba4e061da3', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for project e70d7b30abc14fcab2ffb23660891757. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Getting quotas for user d10d3929c7314a639db592a13ffca375 and project e70d7b30abc14fcab2ffb23660891757. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:28:12 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:28:13 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-921350b5-98ff-457a-8120-24dbfd7d71d9 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.683662 Apr 20 13:28:13 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 89/260] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:28:12 2023] POST /compute/v2.1/servers => generated 399 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:28:13 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-edd8c795-bdb0-44ae-a26e-967ff3da439b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:13 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-edd8c795-bdb0-44ae-a26e-967ff3da439b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:13 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-plugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:13 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] Creating event network-vif-plugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:28:13 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-edd8c795-bdb0-44ae-a26e-967ff3da439b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:13 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-a5fbda6a-4b81-4c95-b53f-9c869757e75c req-cce565d5-6be1-412c-8790-d74865d8358c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037734 Apr 20 13:28:13 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 84/261] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:13 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-edd8c795-bdb0-44ae-a26e-967ff3da439b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 200 len: 1230 microversion: 2.1 time: 0.076873 Apr 20 13:28:13 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 89/262] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:13 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 1230 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] [instance: 4cc90d45-d514-417c-81fa-a96c4a704968] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:13 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] HTTP exception thrown: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Request method failure captured: Apr 20 13:28:13 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 HTTP/1.1 Apr 20 13:28:13 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:28:13 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:28:13 user devstack@n-api.service[61277]: Connection: close Apr 20 13:28:13 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:28:13 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:28:13 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:28:13 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:28:13 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTxlbsvyu5uSKHIOkXr1jf40JCkA1rOrmX2lvn85Ch5SWnuEzx63AcC46kgx4EVz_xZChvcfNk2Mz7v2x5Uz3pI2K1kfgy7G8Wo9qOu8MwAooh_AWyIb1apbh4lH26IOewMBwreweoOzJN3JJpLXMHamcOPvQPktYPUDa3sVqY3qrwo Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Project-Id: 4a526e5a9ffe4ec6a153bb0bc218913e Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4a526e5a9ffe4ec6a153bb0bc218913e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Tenant: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Tenant-Id: 4a526e5a9ffe4ec6a153bb0bc218913e Apr 20 13:28:13 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-616842808 Apr 20 13:28:13 user devstack@n-api.service[61277]: X-User: tempest-ServerRescueNegativeTestJSON-616842808-project-member Apr 20 13:28:13 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:28:13 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:28:13 user devstack@n-api.service[61277]: X-User-Id: c7e63be0504a4fcca19c8b86d95c699d Apr 20 13:28:13 user devstack@n-api.service[61277]: X-User-Name: tempest-ServerRescueNegativeTestJSON-616842808-project-member Apr 20 13:28:13 user devstack@n-api.service[61277]: method: > Apr 20 13:28:13 user devstack@n-api.service[61277]: exception: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. Apr 20 13:28:13 user devstack@n-api.service[61277]: action_args: {'id': '4cc90d45-d514-417c-81fa-a96c4a704968'} Apr 20 13:28:13 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. Apr 20 13:28:13 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:28:13 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] Returning 404 to user: Instance 4cc90d45-d514-417c-81fa-a96c4a704968 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:28:13 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-5d4be98d-015e-421c-a263-a0d9d7874ce0 tempest-ServerRescueNegativeTestJSON-616842808 tempest-ServerRescueNegativeTestJSON-616842808-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968" status: 404 len: 111 microversion: 2.1 time: 0.044449 Apr 20 13:28:13 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:13 2023] GET /compute/v2.1/servers/4cc90d45-d514-417c-81fa-a96c4a704968 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:28:15 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:15 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] Creating event network-changed:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:28:15 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-79784246-07fb-41fe-8b4c-83ac60d585fe req-25128f59-5608-49b9-83ff-d6e7cdc026bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041584 Apr 20 13:28:15 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 85/264] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:17 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "name": "network-vif-plugged", "status": "completed", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:18 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] Creating event network-vif-plugged:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:28:18 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-8080e5d1-2955-4b1e-b9e9-9daa9f1089d0 req-02e77c10-c918-49df-8300-0918b3ec6891 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053174 Apr 20 13:28:18 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 90/265] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:20 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "name": "network-vif-plugged", "status": "completed", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:20 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] Creating event network-vif-plugged:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:28:20 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-0380b0cb-8c8c-4626-a9f5-794a029203b6 req-ee4612f4-b719-40dd-bfe3-8990f2ba57a5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033663 Apr 20 13:28:20 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 91/266] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=14 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:27 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:28:27 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 HTTP/1.1 Apr 20 13:28:27 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:28:27 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:28:27 user devstack@n-api.service[61279]: Connection: close Apr 20 13:28:27 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:28:27 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:28:27 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:28:27 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:28:27 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:28:27 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:28:27 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:28:27 user devstack@n-api.service[61279]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:28:27 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:28:27 user devstack@n-api.service[61279]: method: > Apr 20 13:28:27 user devstack@n-api.service[61279]: exception: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:28:27 user devstack@n-api.service[61279]: action_args: {'id': '749ad860-afb9-48e8-98d3-761700ee6383'} Apr 20 13:28:27 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:28:27 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:28:27 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:28:27 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-3e4f0815-e33d-4c6e-9524-fd6ba5034578 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 404 len: 111 microversion: 2.1 time: 0.037069 Apr 20 13:28:27 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 86/267] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:27 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:28:27 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=10 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0fb145ca-9e99-4bdc-9d60-4f1e9b1b4b23 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '.version_select at 0x7f31d912af80>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:27 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0fb145ca-9e99-4bdc-9d60-4f1e9b1b4b23 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463405458" status: 202 len: 0 microversion: 2.1 time: 0.029656 Apr 20 13:28:27 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 91/268] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 13:28:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1463405458 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=8 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-b809cd20-d84b-434a-8790-4f1a43557d63 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: .version_select at 0x7f31d9165090>, body: {"keypair": {"name": "tempest-keypair-1148524616", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGftekucVMWYDBstiCf693PJI0RA9hhFi83USi+BhF6sa7ZuL08dmVfuvzUwCloSsl9q9qdigSgIzQ/qtb/tSCvMycRuzwpDVW0VO2x5YknjUts7l6qazQOV9mmjzB+j4g=="}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-b809cd20-d84b-434a-8790-4f1a43557d63 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:27 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-b809cd20-d84b-434a-8790-4f1a43557d63 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:27 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-b809cd20-d84b-434a-8790-4f1a43557d63 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055213 Apr 20 13:28:27 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 92/269] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:28:27 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:29 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-207009442", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "95ff1fea-83ff-461e-bfcd-53d8d8d798db"}], "security_groups": [{"name": "tempest-securitygroup--207697767"}], "key_name": "tempest-keypair-1148524616", "user_data": "}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:29 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] validate_networks() for [('95ff1fea-83ff-461e-bfcd-53d8d8d798db', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Getting quotas for user 8628293b2eee4978a6d12739f2af2869 and project 7c4e150c3a1d4521bee2f19a799025b8. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:28:30 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:28:30 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-c08e5194-86cf-4d1d-9df7-293da2a6c80c tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.895620 Apr 20 13:28:30 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 87/270] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:28:29 2023] POST /compute/v2.1/servers => generated 399 bytes in 897 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:28:30 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-ebf5c39f-9251-437e-b774-f157d417c896 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:30 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-ebf5c39f-9251-437e-b774-f157d417c896 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:30 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-ebf5c39f-9251-437e-b774-f157d417c896 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-ebf5c39f-9251-437e-b774-f157d417c896 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 200 len: 1235 microversion: 2.1 time: 0.078184 Apr 20 13:28:30 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 92/271] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:30 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 1235 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:32 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:32 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] Creating event network-changed:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:28:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-750b5f9a-81cb-4843-b946-5f66a50cb174 req-371415bc-e3bd-4954-ba7a-d230a9aec89d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037723 Apr 20 13:28:32 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 93/272] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:35 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "name": "network-vif-plugged", "status": "completed", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:35 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:35 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] Creating event network-vif-plugged:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:28:35 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-94313c5c-3650-4ef0-9ec1-5d0afde85f3e req-3b81233d-db74-4c88-a8f4-61a14377d514 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061585 Apr 20 13:28:35 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 88/273] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:37 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "name": "network-vif-plugged", "status": "completed", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:37 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:37 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:37 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] Creating event network-vif-plugged:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:28:37 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-51462ff9-0104-445b-85ca-eaf2e5a897fc req-d7aa79bf-4065-442e-a40b-030cd461a464 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044219 Apr 20 13:28:37 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 93/274] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-7677f1d0-2562-4747-a71c-dac79334379e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.180465 Apr 20 13:28:40 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 94/275] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 13:28:40 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9/os-interface => generated 283 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:41 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a8b58aa9-4753-41ca-a773-0910bae79df2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 200 len: 1692 microversion: 2.87 time: 0.523647 Apr 20 13:28:41 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 89/276] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:28:41 2023] GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 1692 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:28:41 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:41 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:41 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] Creating event network-changed:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:28:41 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-afc1f0ee-ad40-4873-86c8-f62e2cdbfcbd req-24336c61-888c-462d-b763-c4448b234239 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033873 Apr 20 13:28:41 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 94/277] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:41 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:42 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-832783e4-f22b-4f26-8611-22f3bddeaa06 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9/ips" status: 200 len: 110 microversion: 2.20 time: 0.034217 Apr 20 13:28:42 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 95/278] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 13:28:42 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9/ips => generated 110 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:43 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:28:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-7bd04846-d1e3-4d11-926c-0de0ff2682d7 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 204 len: 0 microversion: 2.20 time: 0.115263 Apr 20 13:28:43 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 90/279] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:28:43 2023] DELETE /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:43 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "name": "network-vif-unplugged", "status": "completed", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:43 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:43 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] Creating event network-vif-unplugged:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:28:43 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-3181cb9b-93b2-4519-85cd-1323465b1543 req-72726ed1-cb48-49c2-9926-0089bd874bf1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028923 Apr 20 13:28:43 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 96/280] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:43 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:43 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:43 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a5e962f4-c559-437a-acf5-2e125ce0594c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 200 len: 1711 microversion: 2.20 time: 0.372504 Apr 20 13:28:43 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 95/281] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:28:43 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 1711 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:45 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-f9f7109f-f9fd-4204-aa72-a670ee1e6985 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.264045 Apr 20 13:28:45 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 91/282] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:45 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:45 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ebaf58d3-54b0-4f9f-a1da-2909d790fa5b tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.241920 Apr 20 13:28:45 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 97/283] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:45 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:45 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-b2f12e04-66db-4c1d-ab6b-11625d283790 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.210869 Apr 20 13:28:45 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 96/284] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:45 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "name": "network-vif-plugged", "status": "completed", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}, {"server_uuid": "e2292f71-022e-4951-a847-b8e00c185bc9", "name": "network-vif-deleted", "tag": "d13d9dab-05db-4d63-9c03-955610823076"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:45 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:45 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Creating event network-vif-plugged:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:28:45 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] Creating event network-vif-deleted:d13d9dab-05db-4d63-9c03-955610823076 for instance e2292f71-022e-4951-a847-b8e00c185bc9 on user Apr 20 13:28:45 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-d3e08a5f-55b7-4745-8b79-37e0a47935dd req-6f48f71e-5747-466b-8a00-e2d00d1af07a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028235 Apr 20 13:28:45 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 92/285] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:28:45 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=18 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:28:56 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1be4f770c4bc386f125d3bbea0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9130c8724534f37802e04fb58034fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:28:56 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ca41ab9b-1a9d-4b06-9465-ea4f43fd23f4 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 200 len: 1569 microversion: 2.1 time: 0.209096 Apr 20 13:28:56 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 98/286] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:28:56 2023] GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=7 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=16 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:03 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-441d60aa-e1cd-439c-aa2a-6be496098806 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 200 len: 1535 microversion: 2.1 time: 0.220318 Apr 20 13:29:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 97/287] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:29:03 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 1535 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:20 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:20 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-d664ff3f-dd40-45db-ad22-0850e1f64ac8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 200 len: 1543 microversion: 2.1 time: 0.246445 Apr 20 13:29:20 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 93/288] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:29:20 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 1543 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:34 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:29:34 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 HTTP/1.1 Apr 20 13:29:34 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:29:34 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:29:34 user devstack@n-api.service[61277]: Connection: close Apr 20 13:29:34 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:29:34 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:29:34 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:29:34 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:29:34 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:29:34 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:29:34 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:29:34 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:29:34 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:29:34 user devstack@n-api.service[61277]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:29:34 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:29:34 user devstack@n-api.service[61277]: method: > Apr 20 13:29:34 user devstack@n-api.service[61277]: exception: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:29:34 user devstack@n-api.service[61277]: action_args: {'id': 'e2292f71-022e-4951-a847-b8e00c185bc9'} Apr 20 13:29:34 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:29:34 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:29:34 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:29:34 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-11d43779-ebb4-4f9e-9df2-f66b15b5461c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 404 len: 111 microversion: 2.20 time: 0.037984 Apr 20 13:29:34 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 99/289] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:29:34 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:29:34 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c00ee586-1dfa-4410-8aee-ec19204514ce tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '.version_select at 0x7f31d912b5b0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:34 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-c00ee586-1dfa-4410-8aee-ec19204514ce tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878814337" status: 204 len: 0 microversion: 2.20 time: 0.029916 Apr 20 13:29:34 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 98/290] 10.0.0.210 () {64 vars in 1339 bytes} [Thu Apr 20 13:29:34 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1878814337 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:29:34 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:34 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-4c577a16-23f6-45fe-b198-5f301e8efb8c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Action: 'create', calling method: .version_select at 0x7f31d91b2b90>, body: {"keypair": {"name": "tempest-keypair-391138873", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQM3LR5hwcGrI4vtIcgu9Eg8gvhGMC4gOBWo3WZ+4CZIFlFJH1l/agQ45+r6Til+mhcROIcp5HrPXp9WMEatv8QRO3OGc78Ipr41w0RgYjvEAsM542IlBGHH0rMHtgr3Q=="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:34 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4c577a16-23f6-45fe-b198-5f301e8efb8c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:29:34 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-4c577a16-23f6-45fe-b198-5f301e8efb8c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for user 52b0f0cdb4f34677bd872c372099348e and project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:29:34 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-4c577a16-23f6-45fe-b198-5f301e8efb8c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.053262 Apr 20 13:29:34 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 94/291] 10.0.0.210 () {66 vars in 1277 bytes} [Thu Apr 20 13:29:34 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1605565700", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "7a857017-af57-4923-870a-2b021087802c"}], "security_groups": [{"name": "tempest-securitygroup--1435247298"}], "key_name": "tempest-keypair-391138873", "user_data": "}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] validate_networks() for [('7a857017-af57-4923-870a-2b021087802c', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Getting quotas for user 52b0f0cdb4f34677bd872c372099348e and project 3f2dab10c3a345fabf6b5740bfbfa82e. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:29:36 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:29:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-b2baba44-d22a-42b2-9f9b-6438439e7150 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.602724 Apr 20 13:29:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 100/292] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:29:36 2023] POST /compute/v2.1/servers => generated 400 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:29:36 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:36 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:36 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:36 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:36 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:36 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-047605ac-16eb-4db8-b91a-422f0399475c tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 200 len: 1275 microversion: 2.20 time: 0.071913 Apr 20 13:29:36 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 99/293] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:29:36 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 1275 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:29:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] Creating event network-changed:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:29:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-e567100a-ec7d-42ee-949d-b6e8665f12a0 req-7df8c3d4-3013-4e9d-bba4-a38e4ee1986d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029181 Apr 20 13:29:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 95/294] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:29:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:29:41 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "name": "network-vif-plugged", "status": "completed", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:41 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:41 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] Creating event network-vif-plugged:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:29:41 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-09281687-6a7b-4368-901c-b4a41ca7cf31 req-176ab2f8-eeb6-4214-a718-b081c3b5532c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040446 Apr 20 13:29:41 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 101/295] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:29:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-392605817"}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:41 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-ff7bb62f-67bc-4388-88c9-39065e8de2af tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf/action" status: 202 len: 52 microversion: 2.87 time: 0.822443 Apr 20 13:29:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 100/296] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 13:29:41 2023] POST /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf/action => generated 52 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 13:29:43 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "name": "network-vif-plugged", "status": "completed", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:43 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] Creating event network-vif-plugged:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:29:43 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-e9a95171-5330-453d-ad46-118d8418d391 req-55827b7b-00f9-4ebb-a6c5-ddc978314798 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029890 Apr 20 13:29:43 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 96/297] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:29:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:47 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:47 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f72d9f83-e43f-4f36-81af-ec520e46e51d tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1656 microversion: 2.1 time: 0.251934 Apr 20 13:29:47 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 102/298] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:29:47 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1656 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:47 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:48 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:48 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:48 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-c6b416d9-9fd6-4616-b1ef-d3cf63dd8b51 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 200 len: 1692 microversion: 2.87 time: 0.280924 Apr 20 13:29:48 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 101/299] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:29:47 2023] GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 1692 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:56 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1be4f770c4bc386f125d3bbea0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9130c8724534f37802e04fb58034fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:56 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-57046de5-b51f-4785-8cc3-0eac1963816f tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 200 len: 1569 microversion: 2.1 time: 0.223646 Apr 20 13:29:56 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 97/300] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:29:56 2023] GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=12 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:58 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:29:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-8c8a1142-ae32-4a47-8e4f-4520a4efd33e tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 204 len: 0 microversion: 2.1 time: 0.112154 Apr 20 13:29:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 103/301] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:29:58 2023] DELETE /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:58 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-unplugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] Creating event network-vif-unplugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:29:58 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54c1be4f770c4bc386f125d3bbea0f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9130c8724534f37802e04fb58034fdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:29:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-0585621e-04fc-43d6-9785-057ae61cf3e1 req-0cb6c2f1-34ca-45cf-8687-0ccb6a540b1b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036457 Apr 20 13:29:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 98/302] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:29:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:29:58 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-285060e9-c174-4dd0-8682-978d86fe1260 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 200 len: 1575 microversion: 2.1 time: 0.241514 Apr 20 13:29:58 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:29:58 2023] GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 1575 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:29:59 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-deleted", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:29:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:29:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:29:59 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:29:59 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] Creating event network-vif-deleted:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:29:59 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-6328b941-83a5-4e5a-b50d-2be3f5e8f227 req-8ab914dd-8715-4f1e-bca8-f04be55e97f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039926 Apr 20 13:29:59 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 104/304] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:29:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:30:00 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-plugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}, {"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-plugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}, {"server_uuid": "91afc4cf-f239-4727-9bea-7544458add97", "name": "network-vif-plugged", "status": "completed", "tag": "bc2ece76-1082-4629-b092-3b00f0578bb5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:00 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:00 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:00 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:00 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Creating event network-vif-plugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:30:00 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Creating event network-vif-plugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:30:00 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] Creating event network-vif-plugged:bc2ece76-1082-4629-b092-3b00f0578bb5 for instance 91afc4cf-f239-4727-9bea-7544458add97 on user Apr 20 13:30:00 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-08342dec-1bc9-4fbd-95d4-b8373488975a req-2762e213-9594-4b5c-b74c-df3aba3f1601 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033273 Apr 20 13:30:00 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 99/305] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:00 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-795567ed-8d88-4797-9499-8b85ad7f30cb tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.155961 Apr 20 13:30:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 103/306] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:30:03 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:04 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:04 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] Creating event network-changed:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:30:04 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-6ac061a8-20eb-49e3-8b7a-81c61b628a36 req-b43beefd-7f64-4e9c-a396-89cf78608c81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029718 Apr 20 13:30:04 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:04 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-0ffaef21-3667-4433-b5e2-3b78f8e2f968 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8/ips" status: 200 len: 104 microversion: 2.1 time: 0.040363 Apr 20 13:30:04 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 100/308] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:30:04 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8/ips => generated 104 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:05 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:30:05 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4ce8d918-2c52-40b6-b437-5978001b500c tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 204 len: 0 microversion: 2.1 time: 0.112022 Apr 20 13:30:05 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 104/309] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:30:05 2023] DELETE /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:06 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "name": "network-vif-unplugged", "status": "completed", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:06 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] Creating event network-vif-unplugged:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:30:06 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd10d3929c7314a639db592a13ffca375', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e70d7b30abc14fcab2ffb23660891757', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:06 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-b70a8355-4f85-4b7d-b258-229aa1ebacad req-713ad0d2-a669-4ba2-9531-00e2ba3b386d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032546 Apr 20 13:30:06 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 101/310] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:06 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-ac823b81-b446-444e-903e-1c0b96776f18 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 200 len: 1660 microversion: 2.1 time: 0.380121 Apr 20 13:30:06 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 106/311] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:05 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 1660 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 13:30:07 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "name": "network-vif-deleted", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:07 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] Creating event network-vif-deleted:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:30:07 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-bb9faac6-c6e5-4d46-a192-646b88523875 req-ef57b8db-8d86-42eb-bf92-27f3e8bd2a1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029534 Apr 20 13:30:07 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:08 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "756f79ea-8784-40e1-84ed-b5ffd2e782b8", "name": "network-vif-plugged", "status": "completed", "tag": "967c0750-5d13-46f2-b0e8-aaaf30067ea0"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:08 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:08 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] Creating event network-vif-plugged:967c0750-5d13-46f2-b0e8-aaaf30067ea0 for instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 on user Apr 20 13:30:08 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-14801b56-8dc0-4a93-a9db-411f67923083 req-78b432d6-11e2-4ac2-b0c3-d2dcbdbb54dd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030908 Apr 20 13:30:08 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 102/313] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:20 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f9d30873-5dbc-4dae-8c62-56caef46f236 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.183010 Apr 20 13:30:20 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 107/314] 10.0.0.210 () {62 vars in 1352 bytes} [Thu Apr 20 13:30:20 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678/os-interface => generated 282 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] Creating event network-changed:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:30:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-3ae2aaf4-49a5-4de7-8f9b-0896547d0633 req-5e29fb61-ec76-44ce-b91e-c450f396c73e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038357 Apr 20 13:30:21 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 106/315] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=12 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=18 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:21 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-fbb5a465-addf-4ee3-858d-6197b586307a tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678/ips" status: 200 len: 107 microversion: 2.1 time: 0.045479 Apr 20 13:30:21 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 103/316] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:30:21 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678/ips => generated 107 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:23 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:30:23 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-a47cd8cc-eb70-472e-ac7d-f371e342cd15 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 204 len: 0 microversion: 2.1 time: 0.103933 Apr 20 13:30:23 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 108/317] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:30:23 2023] DELETE /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:23 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8628293b2eee4978a6d12739f2af2869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c4e150c3a1d4521bee2f19a799025b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:23 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4ef8c792-43c9-4d47-ae28-a331dbfcf3d8 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 200 len: 1668 microversion: 2.1 time: 0.272889 Apr 20 13:30:23 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 107/318] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:23 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 1668 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:30:23 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "name": "network-vif-unplugged", "status": "completed", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}, {"server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "name": "network-vif-plugged", "status": "completed", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Creating event network-vif-unplugged:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:30:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] Creating event network-vif-plugged:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:30:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-a623a940-a7e5-42c0-81a0-66942d9079d8 req-a3fbc000-75d4-4a6b-a29f-3e75e2373dde service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030098 Apr 20 13:30:23 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 104/319] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:23 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:24 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c01fc0ba-e27c-4f2f-bb2c-8e556a191678", "name": "network-vif-deleted", "tag": "c530132d-d1ea-412b-9631-5133774e2f22"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] Creating event network-vif-deleted:c530132d-d1ea-412b-9631-5133774e2f22 for instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 on user Apr 20 13:30:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-e39319f1-b688-4026-8e88-bd16834419e0 req-8dc45644-988b-45c1-bdf3-f8ba2c7108e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035912 Apr 20 13:30:24 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 109/320] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:26 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:27 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:27 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:27 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:27 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-1ee3b0ff-4243-44bf-9953-c72518334b7e tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 200 len: 1586 microversion: 2.20 time: 0.216124 Apr 20 13:30:27 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 108/321] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:30:26 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 1586 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-c7a5da22-4007-4213-9725-715a8c723f88 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 204 len: 0 microversion: 2.1 time: 0.126113 Apr 20 13:30:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 105/322] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:30:48 2023] DELETE /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-369025715", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "eae33ff8-4b9e-47ed-ae38-92bbb5103d34"}]}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:48 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=14 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:30:48 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] validate_networks() for [('eae33ff8-4b9e-47ed-ae38-92bbb5103d34', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "name": "network-vif-unplugged", "status": "completed", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] Creating event network-vif-unplugged:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-076f07e6-8b5d-4963-8f39-e44badee9a78 req-0cee6c74-84e7-4c9a-aaee-e81c2b6edc8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035261 Apr 20 13:30:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 106/323] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] [instance: 91afc4cf-f239-4727-9bea-7544458add97] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] HTTP exception thrown: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Request method failure captured: Apr 20 13:30:48 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 HTTP/1.1 Apr 20 13:30:48 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:30:48 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:30:48 user devstack@n-api.service[61279]: Connection: close Apr 20 13:30:48 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:30:48 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:30:48 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:30:48 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:30:48 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT3bhxQks4xPejxjPpYiYLN5rG6cesPk-KOT_f0-KoFCbSnACTQwFq_W2RVb_hnp1ZbEOtSttD2ro7fLrKGdLanGYJJ34Q8vxqDZUEvwHPXWIy5EgKHGyquGBgl3kevoX6vvw915hjtGQeVwpRhlxyL62OoE6s7ZMCF_k0de5ReN3-4 Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Project-Id: f9130c8724534f37802e04fb58034fdb Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Project-Name: tempest-SnapshotDataIntegrityTests-1047467491 Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9130c8724534f37802e04fb58034fdb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f9130c8724534f37802e04fb58034fdb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f9130c8724534f37802e04fb58034fdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Tenant: tempest-SnapshotDataIntegrityTests-1047467491 Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Tenant-Id: f9130c8724534f37802e04fb58034fdb Apr 20 13:30:48 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-1047467491 Apr 20 13:30:48 user devstack@n-api.service[61279]: X-User: tempest-SnapshotDataIntegrityTests-1047467491-project-member Apr 20 13:30:48 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:30:48 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:30:48 user devstack@n-api.service[61279]: X-User-Id: 54c1be4f770c4bc386f125d3bbea0f1b Apr 20 13:30:48 user devstack@n-api.service[61279]: X-User-Name: tempest-SnapshotDataIntegrityTests-1047467491-project-member Apr 20 13:30:48 user devstack@n-api.service[61279]: method: > Apr 20 13:30:48 user devstack@n-api.service[61279]: exception: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. Apr 20 13:30:48 user devstack@n-api.service[61279]: action_args: {'id': '91afc4cf-f239-4727-9bea-7544458add97'} Apr 20 13:30:48 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. Apr 20 13:30:48 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Returning 404 to user: Instance 91afc4cf-f239-4727-9bea-7544458add97 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-219da271-d42b-4112-a3be-cfcfabfbe1d0 tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97" status: 404 len: 111 microversion: 2.1 time: 0.028921 Apr 20 13:30:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 107/324] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:48 2023] GET /compute/v2.1/servers/91afc4cf-f239-4727-9bea-7544458add97 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:30:48 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'badaaf29beb14beeb94db96f7bc995b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332b3979ef1244e1aff870bbc27a9817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:48 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-04387c75-fa5b-4adb-aecb-1dd831157019 tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 200 len: 1662 microversion: 2.1 time: 0.331742 Apr 20 13:30:48 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 110/325] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:48 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 1662 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:30:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-8354b626-2cf3-46c4-82cb-f852cea67b7b tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] Calling method '.version_select at 0x7f31d91b27a0>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-8354b626-2cf3-46c4-82cb-f852cea67b7b tempest-SnapshotDataIntegrityTests-1047467491 tempest-SnapshotDataIntegrityTests-1047467491-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1506709410" status: 202 len: 0 microversion: 2.1 time: 0.026287 Apr 20 13:30:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1355 bytes} [Thu Apr 20 13:30:48 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1506709410 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for user c3692be8cf1e4aaca3064315bd58925d and project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:30:49 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:30:49 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-d3f0b956-9fe1-4c7f-b09e-8a68174f72b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.277038 Apr 20 13:30:49 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 109/327] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:30:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:30:49 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:49 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:49 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:49 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:49 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:30:49 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-768c1cec-f9fb-432f-a746-abb02394747c tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630" status: 200 len: 1394 microversion: 2.87 time: 0.086883 Apr 20 13:30:49 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 111/328] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:30:49 2023] GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630 => generated 1394 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:30:50 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "name": "network-vif-deleted", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:50 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] Creating event network-vif-deleted:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:30:50 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-02c045df-7cbd-4767-8880-4d15ae6791c5 req-18fb922b-f350-4d83-b10c-73e7cc457c14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046172 Apr 20 13:30:50 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 109/329] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:50 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ed69e99-3ddf-4cac-95f6-0be6a8f04d57", "name": "network-vif-plugged", "status": "completed", "tag": "c4e65624-4f7f-4121-98cb-1d165ce1daa5"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:50 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:50 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] Creating event network-vif-plugged:c4e65624-4f7f-4121-98cb-1d165ce1daa5 for instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 on user Apr 20 13:30:50 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-efb14c9a-f02f-4f94-afae-3479a0b25f64 req-f8d8b7d7-2ff4-466c-892f-9824972bbecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035392 Apr 20 13:30:50 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 110/330] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:52 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec257eb-0188-434f-a3ee-8226d7258630", "tag": "cb26f860-15d6-483d-bdb1-28d6d4854309"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] Creating event network-changed:cb26f860-15d6-483d-bdb1-28d6d4854309 for instance dec257eb-0188-434f-a3ee-8226d7258630 on user Apr 20 13:30:52 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-427f4a22-df28-4822-816c-f807456bac35 req-96ec4bd2-16a2-4923-933b-682dd578a0b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028820 Apr 20 13:30:52 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 112/331] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:56 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:30:56 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 HTTP/1.1 Apr 20 13:30:56 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:30:56 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:30:56 user devstack@n-api.service[61279]: Connection: close Apr 20 13:30:56 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:30:56 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:30:56 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:30:56 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:30:56 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:56 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:30:56 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:30:56 user devstack@n-api.service[61279]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:30:56 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:56 user devstack@n-api.service[61279]: method: > Apr 20 13:30:56 user devstack@n-api.service[61279]: exception: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:56 user devstack@n-api.service[61279]: action_args: {'id': '756f79ea-8784-40e1-84ed-b5ffd2e782b8'} Apr 20 13:30:56 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:56 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:56 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:56 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-fde19dd9-29b8-4778-a01a-0b1420756ae4 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 404 len: 111 microversion: 2.1 time: 0.249721 Apr 20 13:30:56 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 110/332] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:56 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:30:56 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-8859c4e8-68fa-43ac-a54e-798237cc21ce tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '.version_select at 0x7f31d91923b0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:56 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-8859c4e8-68fa-43ac-a54e-798237cc21ce tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-61642113" status: 202 len: 0 microversion: 2.1 time: 0.024353 Apr 20 13:30:56 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 111/333] 10.0.0.210 () {62 vars in 1292 bytes} [Thu Apr 20 13:30:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-61642113 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec257eb-0188-434f-a3ee-8226d7258630", "name": "network-vif-deleted", "tag": "cb26f860-15d6-483d-bdb1-28d6d4854309"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.compute.server_external_events [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] Unable to find a host for instance dec257eb-0188-434f-a3ee-8226d7258630. Dropping event network-vif-deleted {{(pid=61277) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 13:30:57 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-25b6888c-eccd-41c1-a6bf-2f3e358816c2 req-ca8bf05b-0cf0-44cc-9b6e-7cc2f0f43ae3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.026541 Apr 20 13:30:57 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 113/334] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:30:57 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:30:57 user devstack@n-api.service[61279]: request: DELETE /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 HTTP/1.1 Apr 20 13:30:57 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:30:57 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:30:57 user devstack@n-api.service[61279]: Connection: close Apr 20 13:30:57 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:30:57 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:30:57 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:30:57 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:30:57 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61279]: method: > Apr 20 13:30:57 user devstack@n-api.service[61279]: exception: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: action_args: {'id': '756f79ea-8784-40e1-84ed-b5ffd2e782b8'} Apr 20 13:30:57 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-6d547479-ab87-4062-bd0e-ab977e89fc2b tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 404 len: 111 microversion: 2.1 time: 0.029621 Apr 20 13:30:57 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:30:57 2023] DELETE /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 756f79ea-8784-40e1-84ed-b5ffd2e782b8] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:30:57 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 HTTP/1.1 Apr 20 13:30:57 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:30:57 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:30:57 user devstack@n-api.service[61278]: Connection: close Apr 20 13:30:57 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:30:57 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:30:57 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:30:57 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:30:57 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61278]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:30:57 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61278]: method: > Apr 20 13:30:57 user devstack@n-api.service[61278]: exception: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61278]: action_args: {'id': '756f79ea-8784-40e1-84ed-b5ffd2e782b8'} Apr 20 13:30:57 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. Apr 20 13:30:57 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 756f79ea-8784-40e1-84ed-b5ffd2e782b8 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:57 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9f753ec2-f10f-4361-8172-47416ebe75f6 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8" status: 404 len: 111 microversion: 2.1 time: 0.028913 Apr 20 13:30:57 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 112/336] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:57 2023] GET /compute/v2.1/servers/756f79ea-8784-40e1-84ed-b5ffd2e782b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:30:57 user devstack@n-api.service[61277]: request: DELETE /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe HTTP/1.1 Apr 20 13:30:57 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:30:57 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:30:57 user devstack@n-api.service[61277]: Connection: close Apr 20 13:30:57 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:30:57 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:30:57 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:30:57 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:30:57 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61277]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:30:57 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61277]: method: > Apr 20 13:30:57 user devstack@n-api.service[61277]: exception: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61277]: action_args: {'id': '93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe'} Apr 20 13:30:57 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:57 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-7fbe3cc6-4636-442e-838b-1a2573df4098 tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 404 len: 111 microversion: 2.1 time: 0.031656 Apr 20 13:30:57 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 114/337] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:30:57 2023] DELETE /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] [instance: 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:30:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] HTTP exception thrown: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Request method failure captured: Apr 20 13:30:57 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe HTTP/1.1 Apr 20 13:30:57 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:30:57 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:30:57 user devstack@n-api.service[61279]: Connection: close Apr 20 13:30:57 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:30:57 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:30:57 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:30:57 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:30:57 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT1D95flv3aSNGpNMtebXrrVQU9R0OSEmoXPLChzXAnow4_oEd--7RA3wRQrFAjbA-Oftct-2O2LaTu1LvdPKykLR0TIv4D4Blv-mTcKrKXmajH0bfF3SOyRvAJhFldXIvSiZMd4u4mRfW8k7pc4uFTKKO1Y-eEGf5tRWXCLcknn3Bc Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e70d7b30abc14fcab2ffb23660891757"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant-Id: e70d7b30abc14fcab2ffb23660891757 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1013714110 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Id: d10d3929c7314a639db592a13ffca375 Apr 20 13:30:57 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeTestJSON-1013714110-project-member Apr 20 13:30:57 user devstack@n-api.service[61279]: method: > Apr 20 13:30:57 user devstack@n-api.service[61279]: exception: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: action_args: {'id': '93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe'} Apr 20 13:30:57 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. Apr 20 13:30:57 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:30:57 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] Returning 404 to user: Instance 93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:30:57 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-c82048d8-771b-402e-8390-968db3859c0f tempest-AttachVolumeTestJSON-1013714110 tempest-AttachVolumeTestJSON-1013714110-project-member] 10.0.0.210 "GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe" status: 404 len: 111 microversion: 2.1 time: 0.025948 Apr 20 13:30:57 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:30:57 2023] GET /compute/v2.1/servers/93e3ad2f-6f5d-4779-bd8b-8a5885b78ebe => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 20 13:31:01 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:01 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:01 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-df0a6fb4-007d-4963-91ec-2a41253ea2bb tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Action: 'create', calling method: .version_select at 0x7f31d9190280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1207804709", "metadata": {"Type": "work"}}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:02 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-df0a6fb4-007d-4963-91ec-2a41253ea2bb tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.430859 Apr 20 13:31:02 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 113/339] 10.0.0.210 () {64 vars in 1233 bytes} [Thu Apr 20 13:31:01 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 432 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 20 13:31:02 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-88c00745-f0f6-46a8-b392-48a03573f0c9 tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Calling method '.version_select at 0x7f31d9167490>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:02 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:02 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-88c00745-f0f6-46a8-b392-48a03573f0c9 tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064" status: 200 len: 350 microversion: 2.1 time: 0.055244 Apr 20 13:31:02 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 115/340] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:31:02 2023] GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064 => generated 350 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:03 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-423e1af7-01da-447f-8df4-ea81cc06c170 tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Calling method '.version_select at 0x7f31d91b3520>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:03 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-423e1af7-01da-447f-8df4-ea81cc06c170 tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064" status: 200 len: 350 microversion: 2.1 time: 0.055069 Apr 20 13:31:03 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 113/341] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:31:03 2023] GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d3cc1d5e-e592-4102-8a7b-09b0f5d80b8d tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Calling method '.version_select at 0x7f31d9192710>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-d3cc1d5e-e592-4102-8a7b-09b0f5d80b8d tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064" status: 202 len: 0 microversion: 2.1 time: 0.105066 Apr 20 13:31:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 114/342] 10.0.0.210 () {62 vars in 1325 bytes} [Thu Apr 20 13:31:03 2023] DELETE /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:31:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-cc07092b-4b72-4b03-a197-623e3b03309b tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Calling method '.version_select at 0x7f31d9164310>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-cc07092b-4b72-4b03-a197-623e3b03309b tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] HTTP exception thrown: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. Apr 20 13:31:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-cc07092b-4b72-4b03-a197-623e3b03309b tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Request method failure captured: Apr 20 13:31:03 user devstack@n-api.service[61277]: request: GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064 HTTP/1.1 Apr 20 13:31:03 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:31:03 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:31:03 user devstack@n-api.service[61277]: Connection: close Apr 20 13:31:03 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:31:03 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:31:03 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:31:03 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:31:03 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT6VRLM6erOaO7Im_K4wkmyXHzcS9Pxbm2avHBimeZH55P8SAC3d-zvpSQnD7U852y3pWGDRIm7n0bCK7N0fsr9gLE-ZdNDRrSsbuOd9FEPGoDZsP3MsBGWMNG4ZKNvrbR1lvwjMpn0G18agxJCMHagoIpe-ZKKwsrZ1dbNl6KEWdrI Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Project-Id: d018e2eca5214db9a69bd6e3f88f5f72 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Project-Name: tempest-VolumesGetTestJSON-1228137482 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d018e2eca5214db9a69bd6e3f88f5f72"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d018e2eca5214db9a69bd6e3f88f5f72"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d018e2eca5214db9a69bd6e3f88f5f72"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Tenant: tempest-VolumesGetTestJSON-1228137482 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Tenant-Id: d018e2eca5214db9a69bd6e3f88f5f72 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-VolumesGetTestJSON-1228137482 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-User: tempest-VolumesGetTestJSON-1228137482-project-member Apr 20 13:31:03 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:31:03 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:31:03 user devstack@n-api.service[61277]: X-User-Id: d7e7103efab7476bbe446433c3a74c65 Apr 20 13:31:03 user devstack@n-api.service[61277]: X-User-Name: tempest-VolumesGetTestJSON-1228137482-project-member Apr 20 13:31:03 user devstack@n-api.service[61277]: method: Apr 20 13:31:03 user devstack@n-api.service[61277]: exception: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. Apr 20 13:31:03 user devstack@n-api.service[61277]: action_args: {'id': 'd0168378-01c8-4de5-9e44-9692166f6064'} Apr 20 13:31:03 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. (HTTP 404) (Request-ID: req-ee9b6658-5304-4680-a3b8-323baee1e150) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. Apr 20 13:31:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-cc07092b-4b72-4b03-a197-623e3b03309b tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] Returning 404 to user: Volume d0168378-01c8-4de5-9e44-9692166f6064 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-cc07092b-4b72-4b03-a197-623e3b03309b tempest-VolumesGetTestJSON-1228137482 tempest-VolumesGetTestJSON-1228137482-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064" status: 404 len: 109 microversion: 2.1 time: 0.053857 Apr 20 13:31:03 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 116/343] 10.0.0.210 () {62 vars in 1322 bytes} [Thu Apr 20 13:31:03 2023] GET /compute/v2.1/os-volumes/d0168378-01c8-4de5-9e44-9692166f6064 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:13 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:13 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 HTTP/1.1 Apr 20 13:31:13 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:31:13 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:31:13 user devstack@n-api.service[61279]: Connection: close Apr 20 13:31:13 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:31:13 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:31:13 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:31:13 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:31:13 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:13 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:31:13 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:31:13 user devstack@n-api.service[61279]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:13 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:13 user devstack@n-api.service[61279]: method: > Apr 20 13:31:13 user devstack@n-api.service[61279]: exception: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:13 user devstack@n-api.service[61279]: action_args: {'id': 'c01fc0ba-e27c-4f2f-bb2c-8e556a191678'} Apr 20 13:31:13 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:13 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:13 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:13 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-eff7a4f3-15f0-4310-8ee9-409e9eeeebc6 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 404 len: 111 microversion: 2.1 time: 0.037324 Apr 20 13:31:13 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 114/344] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:13 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:13 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=20,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:13 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:13 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-faac5e8d-a37c-410f-906a-a5ce37539aee tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '.version_select at 0x7f31d9190ca0>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:13 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-faac5e8d-a37c-410f-906a-a5ce37539aee tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148524616" status: 202 len: 0 microversion: 2.1 time: 0.028644 Apr 20 13:31:13 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 115/345] 10.0.0.210 () {62 vars in 1298 bytes} [Thu Apr 20 13:31:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148524616 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=14 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=12 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:14 user devstack@n-api.service[61277]: request: DELETE /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 HTTP/1.1 Apr 20 13:31:14 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:31:14 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:31:14 user devstack@n-api.service[61277]: Connection: close Apr 20 13:31:14 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:31:14 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:31:14 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:31:14 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:31:14 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61277]: method: > Apr 20 13:31:14 user devstack@n-api.service[61277]: exception: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: action_args: {'id': 'c01fc0ba-e27c-4f2f-bb2c-8e556a191678'} Apr 20 13:31:14 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:14 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-1ee44a51-d89d-44b9-863b-c54254390808 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 404 len: 111 microversion: 2.1 time: 0.034522 Apr 20 13:31:14 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 117/346] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:31:14 2023] DELETE /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: c01fc0ba-e27c-4f2f-bb2c-8e556a191678] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:14 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 HTTP/1.1 Apr 20 13:31:14 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:31:14 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:31:14 user devstack@n-api.service[61279]: Connection: close Apr 20 13:31:14 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:31:14 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:31:14 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:31:14 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:31:14 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61279]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:14 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61279]: method: > Apr 20 13:31:14 user devstack@n-api.service[61279]: exception: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61279]: action_args: {'id': 'c01fc0ba-e27c-4f2f-bb2c-8e556a191678'} Apr 20 13:31:14 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance c01fc0ba-e27c-4f2f-bb2c-8e556a191678 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:14 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-dab37c9c-c690-4d25-b64d-a8cd72ae0b81 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678" status: 404 len: 111 microversion: 2.1 time: 0.027617 Apr 20 13:31:14 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 115/347] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:14 2023] GET /compute/v2.1/servers/c01fc0ba-e27c-4f2f-bb2c-8e556a191678 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:14 user devstack@n-api.service[61278]: request: DELETE /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 HTTP/1.1 Apr 20 13:31:14 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:31:14 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:31:14 user devstack@n-api.service[61278]: Connection: close Apr 20 13:31:14 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:31:14 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:31:14 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:31:14 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:31:14 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61278]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:14 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61278]: method: > Apr 20 13:31:14 user devstack@n-api.service[61278]: exception: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61278]: action_args: {'id': '749ad860-afb9-48e8-98d3-761700ee6383'} Apr 20 13:31:14 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:14 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-50be804b-9ff6-4ff2-aa90-60eddd7eb7a5 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 404 len: 111 microversion: 2.1 time: 0.028426 Apr 20 13:31:14 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 116/348] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:31:14 2023] DELETE /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 749ad860-afb9-48e8-98d3-761700ee6383] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:14 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:14 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 HTTP/1.1 Apr 20 13:31:14 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:31:14 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:31:14 user devstack@n-api.service[61277]: Connection: close Apr 20 13:31:14 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:31:14 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:31:14 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:31:14 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:31:14 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:14 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:14 user devstack@n-api.service[61277]: method: > Apr 20 13:31:14 user devstack@n-api.service[61277]: exception: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: action_args: {'id': '749ad860-afb9-48e8-98d3-761700ee6383'} Apr 20 13:31:14 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. Apr 20 13:31:14 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:14 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 749ad860-afb9-48e8-98d3-761700ee6383 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:14 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-04a0f250-9485-497b-adf6-e9ec20c5056b tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383" status: 404 len: 111 microversion: 2.1 time: 0.031567 Apr 20 13:31:14 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 118/349] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:14 2023] GET /compute/v2.1/servers/749ad860-afb9-48e8-98d3-761700ee6383 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:15 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:15 user devstack@n-api.service[61279]: request: DELETE /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 HTTP/1.1 Apr 20 13:31:15 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:31:15 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:31:15 user devstack@n-api.service[61279]: Connection: close Apr 20 13:31:15 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:31:15 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:31:15 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:31:15 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:31:15 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:15 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:31:15 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:31:15 user devstack@n-api.service[61279]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:15 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:15 user devstack@n-api.service[61279]: method: > Apr 20 13:31:15 user devstack@n-api.service[61279]: exception: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61279]: action_args: {'id': '36408db4-ec52-4295-9e62-efa2a32acad5'} Apr 20 13:31:15 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:15 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-0e922158-a1ad-4574-8b83-884689016a96 tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 404 len: 111 microversion: 2.1 time: 0.032562 Apr 20 13:31:15 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:31:15 2023] DELETE /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] [instance: 36408db4-ec52-4295-9e62-efa2a32acad5] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:15 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] HTTP exception thrown: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Request method failure captured: Apr 20 13:31:15 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 HTTP/1.1 Apr 20 13:31:15 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:31:15 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:31:15 user devstack@n-api.service[61278]: Connection: close Apr 20 13:31:15 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:31:15 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:31:15 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:31:15 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:31:15 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTybu0X6aM812RRy0eERENutx6r-HYQr4yEhvN4fMgnrwEzNp8HQyKxTauxPVSiReRFOEPIcr2UwK58lhwRFMXVHsdWz_zs_ZKXE9YlTFBT7r5l9Wx_aEGGV4us1IsZS1tFDR2X6AkZVuoozHcOv1OIkFRSi5jFFxVAVQn101ArxLM0 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Project-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/7c4e150c3a1d4521bee2f19a799025b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Tenant-Id: 7c4e150c3a1d4521bee2f19a799025b8 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1286906181 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:15 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:31:15 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:31:15 user devstack@n-api.service[61278]: X-User-Id: 8628293b2eee4978a6d12739f2af2869 Apr 20 13:31:15 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeNegativeTest-1286906181-project-member Apr 20 13:31:15 user devstack@n-api.service[61278]: method: > Apr 20 13:31:15 user devstack@n-api.service[61278]: exception: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61278]: action_args: {'id': '36408db4-ec52-4295-9e62-efa2a32acad5'} Apr 20 13:31:15 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. Apr 20 13:31:15 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:15 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] Returning 404 to user: Instance 36408db4-ec52-4295-9e62-efa2a32acad5 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:15 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0f2a9878-916a-4356-ba4d-891afe548bfb tempest-AttachVolumeNegativeTest-1286906181 tempest-AttachVolumeNegativeTest-1286906181-project-member] 10.0.0.210 "GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5" status: 404 len: 111 microversion: 2.1 time: 0.028497 Apr 20 13:31:15 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 117/351] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:15 2023] GET /compute/v2.1/servers/36408db4-ec52-4295-9e62-efa2a32acad5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:27 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:27 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-157ddeca-1f57-4926-81e9-649c7e5f2ac0 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.249431 Apr 20 13:31:27 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 119/352] 10.0.0.210 () {64 vars in 1393 bytes} [Thu Apr 20 13:31:27 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49/os-interface => generated 282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:28 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] Creating event network-changed:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:31:28 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-0f1f30eb-6241-4fb1-a10a-6e4ac6f68499 req-5522f069-ef30-4ef7-b630-a687923332c9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035192 Apr 20 13:31:28 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 117/353] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:28 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-392e6d58-1a98-4edf-b1e7-e9a04abfbcae tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49/ips" status: 200 len: 109 microversion: 2.20 time: 0.040096 Apr 20 13:31:28 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 118/354] 10.0.0.210 () {64 vars in 1366 bytes} [Thu Apr 20 13:31:28 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49/ips => generated 109 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:29 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:31:29 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-8d39bd67-705b-43c7-9427-4d600207e766 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 204 len: 0 microversion: 2.20 time: 0.118773 Apr 20 13:31:29 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 120/355] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:31:29 2023] DELETE /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:29 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "name": "network-vif-unplugged", "status": "completed", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '52b0f0cdb4f34677bd872c372099348e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f2dab10c3a345fabf6b5740bfbfa82e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:30 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-ffe9b495-d994-47f8-95f9-5482a6753f31 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 200 len: 1711 microversion: 2.20 time: 0.263025 Apr 20 13:31:30 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 118/356] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:31:29 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 1711 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:31:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] Creating event network-vif-unplugged:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:31:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-fc7c2392-beba-45ed-8bf0-31828d1bb0ff req-bfe2548b-734a-4008-9547-5f96e60292e5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031464 Apr 20 13:31:30 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 119/357] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:31 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "name": "network-vif-deleted", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] Creating event network-vif-deleted:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:31:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-8c1687b3-2eb6-4df1-af2d-0830d08dc7e4 req-7af7cbb1-fa3b-473b-b799-73190f4f0033 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032801 Apr 20 13:31:31 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 121/358] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc7f34-d815-4a96-a439-5dc5f397ed49", "name": "network-vif-plugged", "status": "completed", "tag": "ba92405f-0180-4c0f-ae5b-bf0848f9bfe3"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] Creating event network-vif-plugged:ba92405f-0180-4c0f-ae5b-bf0848f9bfe3 for instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 on user Apr 20 13:31:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-8fa90000-958a-452e-a0b2-22443bc563ee req-618718a7-d1a9-4e73-9582-e5b3d0e01009 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030294 Apr 20 13:31:32 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 119/359] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] [instance: 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:38 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] HTTP exception thrown: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Request method failure captured: Apr 20 13:31:38 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 HTTP/1.1 Apr 20 13:31:38 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:31:38 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:31:38 user devstack@n-api.service[61278]: Connection: close Apr 20 13:31:38 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:31:38 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:31:38 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:31:38 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:31:38 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQTxrq16jwvHHeh0nQa7DNLXD-y5jgdBe25cy73JcY1cNETJfRBdZ3vP7kb8_70MfX91ejtc-IQBH_Ghe2lf8VdiepVhMxC9A16TrjM5SUc4R54ya3i7tQvp1_jB3-JbfHYU6gDHPmkNAQU_YeOEn95HKcC9QpjqPM6Kf_LVuBiSiqh4 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Project-Id: 332b3979ef1244e1aff870bbc27a9817 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Project-Name: tempest-ServerActionsTestJSON-1657714739 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/332b3979ef1244e1aff870bbc27a9817"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/332b3979ef1244e1aff870bbc27a9817"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/332b3979ef1244e1aff870bbc27a9817"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Tenant: tempest-ServerActionsTestJSON-1657714739 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Tenant-Id: 332b3979ef1244e1aff870bbc27a9817 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-ServerActionsTestJSON-1657714739 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-User: tempest-ServerActionsTestJSON-1657714739-project-member Apr 20 13:31:38 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:31:38 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:31:38 user devstack@n-api.service[61278]: X-User-Id: badaaf29beb14beeb94db96f7bc995b0 Apr 20 13:31:38 user devstack@n-api.service[61278]: X-User-Name: tempest-ServerActionsTestJSON-1657714739-project-member Apr 20 13:31:38 user devstack@n-api.service[61278]: method: > Apr 20 13:31:38 user devstack@n-api.service[61278]: exception: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. Apr 20 13:31:38 user devstack@n-api.service[61278]: action_args: {'id': '6ed69e99-3ddf-4cac-95f6-0be6a8f04d57'} Apr 20 13:31:38 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. Apr 20 13:31:38 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:31:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Returning 404 to user: Instance 6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:38 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-acc7b48d-4e4d-405f-a749-9a088f1eb76f tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57" status: 404 len: 111 microversion: 2.1 time: 0.031430 Apr 20 13:31:38 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 120/360] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:38 2023] GET /compute/v2.1/servers/6ed69e99-3ddf-4cac-95f6-0be6a8f04d57 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:31:38 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-beb83268-cd01-4b89-be83-940cb0deacaa tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] Calling method '.version_select at 0x7f31d9165cf0>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:38 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-beb83268-cd01-4b89-be83-940cb0deacaa tempest-ServerActionsTestJSON-1657714739 tempest-ServerActionsTestJSON-1657714739-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-549168830" status: 202 len: 0 microversion: 2.1 time: 0.022637 Apr 20 13:31:38 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 122/361] 10.0.0.210 () {62 vars in 1295 bytes} [Thu Apr 20 13:31:38 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-549168830 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.objects.instance [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lazy-loading 'fault' on Instance uuid dec257eb-0188-434f-a3ee-8226d7258630 {{(pid=61279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:39 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-3e3b0585-b8f3-4cb7-a6fa-9e1d0d3e7161 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630" status: 200 len: 1649 microversion: 2.87 time: 0.102272 Apr 20 13:31:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 120/362] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:31:39 2023] GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630 => generated 1649 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:31:39 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:39 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Doing local delete in cell db6d068e-9cbf-4ca5-a5c2-9826745af97f(cell1) {{(pid=61278) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:40 user devstack@n-api.service[61278]: WARNING nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] instance's host None is down, deleting from database Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] deallocate_for_instance() {{(pid=61278) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Instance cache missing network info. {{(pid=61278) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Updating instance_info_cache with network_info: [] {{(pid=61278) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 13:31:40 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61278) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 13:31:40 user devstack@n-api.service[61278]: WARNING nova.compute.api [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 13:31:40 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-f0114943-d39c-4feb-8c43-d91b27171a11 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630" status: 204 len: 0 microversion: 2.87 time: 0.605634 Apr 20 13:31:40 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 121/363] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:31:39 2023] DELETE /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: dec257eb-0188-434f-a3ee-8226d7258630] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] HTTP exception thrown: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Request method failure captured: Apr 20 13:31:40 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630 HTTP/1.1 Apr 20 13:31:40 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:31:40 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:31:40 user devstack@n-api.service[61277]: Connection: close Apr 20 13:31:40 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:31:40 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:31:40 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:31:40 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:31:40 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT3WgSEc6TkadZ3qvTGsQ7JBuFpeSqsDfM1uzfS0cjbEcix33v6SMe8SDo9yIjPbAIYW8apraZ1623uZmWssOxzBHyAzUtcGyPSMCTjjsc4tJJ2D8dWXDbHULG7Gz-r2mLjpVofNh8ujjaGcq_f6ZKmHS_Vl-nAgDnTSLkJG_g2mgP0 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Project-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Tenant-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:31:40 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:31:40 user devstack@n-api.service[61277]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:31:40 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:31:40 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:31:40 user devstack@n-api.service[61277]: X-User-Id: c3692be8cf1e4aaca3064315bd58925d Apr 20 13:31:40 user devstack@n-api.service[61277]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:31:40 user devstack@n-api.service[61277]: method: > Apr 20 13:31:40 user devstack@n-api.service[61277]: exception: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. Apr 20 13:31:40 user devstack@n-api.service[61277]: action_args: {'id': 'dec257eb-0188-434f-a3ee-8226d7258630'} Apr 20 13:31:40 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. Apr 20 13:31:40 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:31:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Returning 404 to user: Instance dec257eb-0188-434f-a3ee-8226d7258630 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:31:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-93664ddb-5b4d-40b4-a9e2-2ebce0a8cae3 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630" status: 404 len: 111 microversion: 2.87 time: 0.077590 Apr 20 13:31:40 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 123/364] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:31:40 2023] GET /compute/v2.1/servers/dec257eb-0188-434f-a3ee-8226d7258630 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:31:40 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1703798451", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "eae33ff8-4b9e-47ed-ae38-92bbb5103d34"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:40 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] validate_networks() for [('eae33ff8-4b9e-47ed-ae38-92bbb5103d34', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for user c3692be8cf1e4aaca3064315bd58925d and project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:31:41 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:31:41 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-be2a6d4e-a598-4501-b14d-6fd585de69fc tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.091782 Apr 20 13:31:41 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 121/365] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:31:40 2023] POST /compute/v2.1/servers => generated 378 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:31:41 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:41 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:42 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:42 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:42 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9e35f996-0b04-4597-a309-62ad18d7d918 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 200 len: 1395 microversion: 2.87 time: 0.110711 Apr 20 13:31:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 122/366] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:31:41 2023] GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 1395 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:31:44 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:44 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] Creating event network-changed:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:31:44 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-8c1a3aed-cab4-44ae-b870-629456e3e796 req-195a8e98-6046-418e-9678-53b5b92b7bf3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038288 Apr 20 13:31:44 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 124/367] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:44 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:46 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "name": "network-vif-plugged", "status": "completed", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:46 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] Creating event network-vif-plugged:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:31:46 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-b24b68dc-abd2-40b5-b65f-329faae2319c req-a7fd56f2-7187-4e35-89e4-26e88f606da9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055869 Apr 20 13:31:46 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 122/368] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:31:48 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "name": "network-vif-plugged", "status": "completed", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:48 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] Creating event network-vif-plugged:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:31:48 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-d8c1177b-e9aa-43e6-ad44-5765a4542685 req-d163e91c-6368-40d7-a6cb-aae6389ad5c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031017 Apr 20 13:31:48 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 123/369] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:31:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-2d7f8078-0efd-4351-84be-81068206c650 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Action: 'create', calling method: .version_select at 0x7f31d9166b90>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-710722238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHaHLG9/y8tDP2t/XkRy5eJMi6PDGVOU0ppxBmtQ+VDlIuqbTJecEkesqrZzVWjspEObaW12n5nDGRGhHF1gOmaXk16fMWuig0KbpIJp4ljn95oOAm42z5P5HnFHk+QStg=="}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:58 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-2d7f8078-0efd-4351-84be-81068206c650 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:31:58 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-2d7f8078-0efd-4351-84be-81068206c650 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for user 91ff3a4e15a54a63821bd2a43041feda and project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'key_pairs'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:31:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-2d7f8078-0efd-4351-84be-81068206c650 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061821 Apr 20 13:31:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 125/370] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:31:58 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=22 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-611361755", "imageRef": "ab7a56ac-02d0-4889-8617-03469f2cc2b0", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-710722238", "networks": [{"uuid": "16c48cbc-ac65-4bfe-afc7-c8d9e69d1a52"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] validate_networks() for [('16c48cbc-ac65-4bfe-afc7-c8d9e69d1a52', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for user 91ff3a4e15a54a63821bd2a43041feda and project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:31:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ab7a56ac-02d0-4889-8617-03469f2cc2b0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:31:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-5ca1a063-4b68-44cc-8b39-174bdc03984c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.771061 Apr 20 13:31:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 123/371] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:31:58 2023] POST /compute/v2.1/servers => generated 378 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:31:58 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1f34b963-70cc-4799-bc35-dfd75f4c4bcc tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:31:58 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-1f34b963-70cc-4799-bc35-dfd75f4c4bcc tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:31:58 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:58 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:31:59 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-1f34b963-70cc-4799-bc35-dfd75f4c4bcc tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:31:59 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-1f34b963-70cc-4799-bc35-dfd75f4c4bcc tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 200 len: 1251 microversion: 2.1 time: 0.186257 Apr 20 13:31:59 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 124/372] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:31:58 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 1251 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:32:02 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:32:02 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:02 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:02 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:02 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] Creating event network-changed:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:32:02 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-00ce3033-0ac4-451e-a2d8-0ddf0d068fe2 req-240c3c2c-8558-43af-9b9f-2e12070b0ea9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223412 Apr 20 13:32:02 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 126/373] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:32:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:32:04 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "name": "network-vif-plugged", "status": "completed", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:32:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:04 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:04 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] Creating event network-vif-plugged:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:32:04 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-b0567a3b-a57b-4924-9fb3-c0c0f106c451 req-a0877d7e-1827-4b33-ba99-f8bb89d6da81 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037382 Apr 20 13:32:04 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 124/374] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:32:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:32:06 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "name": "network-vif-plugged", "status": "completed", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:32:06 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:06 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:06 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:06 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] Creating event network-vif-plugged:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:32:06 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-d5682a84-6d00-4365-b844-7bdc5f6bd256 req-52673d07-494f-4a8a-8cc3-3cb000195806 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035697 Apr 20 13:32:06 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 125/375] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:20 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:32:20 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 HTTP/1.1 Apr 20 13:32:20 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:32:20 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:32:20 user devstack@n-api.service[61277]: Connection: close Apr 20 13:32:20 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:32:20 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:32:20 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:32:20 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:32:20 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:20 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:20 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:20 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:32:20 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:32:20 user devstack@n-api.service[61277]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:32:20 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:20 user devstack@n-api.service[61277]: method: > Apr 20 13:32:20 user devstack@n-api.service[61277]: exception: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:20 user devstack@n-api.service[61277]: action_args: {'id': '6cbc7f34-d815-4a96-a439-5dc5f397ed49'} Apr 20 13:32:20 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:20 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:20 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:32:20 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-8940e7dd-dd1c-4f57-bb98-310a8ba519c6 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 404 len: 111 microversion: 2.20 time: 0.291563 Apr 20 13:32:20 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 127/376] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:32:20 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 111 bytes in 294 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:32:20 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-587ab3c0-a342-4c8d-884a-cec92431c012 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '.version_select at 0x7f31d9020ee0>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:20 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-587ab3c0-a342-4c8d-884a-cec92431c012 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-391138873" status: 204 len: 0 microversion: 2.20 time: 0.031707 Apr 20 13:32:20 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 125/377] 10.0.0.210 () {64 vars in 1336 bytes} [Thu Apr 20 13:32:20 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-391138873 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:32:21 user devstack@n-api.service[61278]: request: DELETE /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 HTTP/1.1 Apr 20 13:32:21 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:32:21 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:32:21 user devstack@n-api.service[61278]: Connection: close Apr 20 13:32:21 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:32:21 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:32:21 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:32:21 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:32:21 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61278]: method: > Apr 20 13:32:21 user devstack@n-api.service[61278]: exception: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: action_args: {'id': '6cbc7f34-d815-4a96-a439-5dc5f397ed49'} Apr 20 13:32:21 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:32:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-c654a70c-f8c0-4ccf-bf8e-cd7bd971dc94 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 404 len: 111 microversion: 2.20 time: 0.036625 Apr 20 13:32:21 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 126/378] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:32:21 2023] DELETE /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: 6cbc7f34-d815-4a96-a439-5dc5f397ed49] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:32:21 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 HTTP/1.1 Apr 20 13:32:21 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:32:21 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:32:21 user devstack@n-api.service[61277]: Connection: close Apr 20 13:32:21 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:32:21 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:32:21 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:32:21 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:32:21 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61277]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61277]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:32:21 user devstack@n-api.service[61277]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61277]: method: > Apr 20 13:32:21 user devstack@n-api.service[61277]: exception: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61277]: action_args: {'id': '6cbc7f34-d815-4a96-a439-5dc5f397ed49'} Apr 20 13:32:21 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance 6cbc7f34-d815-4a96-a439-5dc5f397ed49 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:32:21 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-4f7c9656-b451-4615-a2e5-26f96be67d59 tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49" status: 404 len: 111 microversion: 2.20 time: 0.026360 Apr 20 13:32:21 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 128/379] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:32:21 2023] GET /compute/v2.1/servers/6cbc7f34-d815-4a96-a439-5dc5f397ed49 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:32:21 user devstack@n-api.service[61279]: request: DELETE /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 HTTP/1.1 Apr 20 13:32:21 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:32:21 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:32:21 user devstack@n-api.service[61279]: Connection: close Apr 20 13:32:21 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:32:21 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:32:21 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:32:21 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:32:21 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61279]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61279]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:32:21 user devstack@n-api.service[61279]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61279]: method: > Apr 20 13:32:21 user devstack@n-api.service[61279]: exception: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61279]: action_args: {'id': 'e2292f71-022e-4951-a847-b8e00c185bc9'} Apr 20 13:32:21 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:32:21 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-cc4bcb96-590a-486f-a37b-0f4e23d087ac tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 404 len: 111 microversion: 2.20 time: 0.030463 Apr 20 13:32:21 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 126/380] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:32:21 2023] DELETE /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] [instance: e2292f71-022e-4951-a847-b8e00c185bc9] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] HTTP exception thrown: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Request method failure captured: Apr 20 13:32:21 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 HTTP/1.1 Apr 20 13:32:21 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:32:21 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:32:21 user devstack@n-api.service[61278]: Connection: close Apr 20 13:32:21 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:32:21 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:32:21 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:32:21 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:32:21 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT2XnXqJSTXgsbfZqMf7b2yYelTXUeOzjiPoZJtC4tqzirqshNwfmdqqp_sEENC56axABLWvEgAglV8GQ1-ud24UCi3qFY6iEiDpyjkNAUrXUwJ0BCHCMnVqCsPrOQD9nQSC5MLN3rdIWJbrdmsGVAv0t_iycdU-OOEq1Jdx_549D2U Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Openstack-Nova-Api-Version: 2.20 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f2dab10c3a345fabf6b5740bfbfa82e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant-Id: 3f2dab10c3a345fabf6b5740bfbfa82e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1138304432 Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Id: 52b0f0cdb4f34677bd872c372099348e Apr 20 13:32:21 user devstack@n-api.service[61278]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1138304432-project-member Apr 20 13:32:21 user devstack@n-api.service[61278]: method: > Apr 20 13:32:21 user devstack@n-api.service[61278]: exception: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: action_args: {'id': 'e2292f71-022e-4951-a847-b8e00c185bc9'} Apr 20 13:32:21 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. Apr 20 13:32:21 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:32:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] Returning 404 to user: Instance e2292f71-022e-4951-a847-b8e00c185bc9 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:32:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-d030fc71-71f5-481a-916d-30133a7be12d tempest-AttachVolumeShelveTestJSON-1138304432 tempest-AttachVolumeShelveTestJSON-1138304432-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9" status: 404 len: 111 microversion: 2.20 time: 0.028783 Apr 20 13:32:21 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 127/381] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:32:21 2023] GET /compute/v2.1/servers/e2292f71-022e-4951-a847-b8e00c185bc9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:32:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:32:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-7c5d8e3c-55c0-4d78-a699-b9eecfded5d4 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 200 len: 1691 microversion: 2.87 time: 0.391572 Apr 20 13:32:32 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 129/382] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:32:32 2023] GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 1691 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=5,nova_api:DELETE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:32:49 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:32:49 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-67fc98ea-7d9c-472b-89d8-8c12e8f61afe tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 200 len: 1536 microversion: 2.1 time: 0.213636 Apr 20 13:32:49 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 127/383] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:32:49 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 1536 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:32:57 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-6825e77f-6c47-4044-95fc-76f4c3d6581d tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] Action: 'create', calling method: .version_select at 0x7f31d906b880>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1073380778", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQ++U0AAWfV9AS8E/OkEQlGKOmnAFXSgkp3o6Yb1I4Z90Y08hpj4MQLOk3PiA4Hi8i7jK4n6YEfjRe2ZfVRqCfpw/UhR3MQttS4YlScgNd+AHz9yJ0GwJG5zw7PZrYyBQ=="}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:32:57 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:57 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:32:57 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-6825e77f-6c47-4044-95fc-76f4c3d6581d tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] Getting quotas for project 4af22b8453374076b0b32e92885d3c12. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:32:57 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-6825e77f-6c47-4044-95fc-76f4c3d6581d tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] Getting quotas for user 1c96d0b29fa64b8a9aa178af8e8e26e6 and project 4af22b8453374076b0b32e92885d3c12. Resources: {'key_pairs'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:32:57 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-6825e77f-6c47-4044-95fc-76f4c3d6581d tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.059692 Apr 20 13:32:57 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 128/384] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:32:57 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:33:00 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-4f8262e5-33f9-4962-b104-b7757e62f0d7 tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] Calling method '.version_select at 0x7f31d9164940>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:00 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:00 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=4 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:00 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-4f8262e5-33f9-4962-b104-b7757e62f0d7 tempest-TestVolumeBootPattern-1409221106 tempest-TestVolumeBootPattern-1409221106-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1073380778" status: 202 len: 0 microversion: 2.1 time: 0.023909 Apr 20 13:33:00 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 130/385] 10.0.0.210 () {62 vars in 1340 bytes} [Thu Apr 20 13:33:00 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1073380778 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-1899337601"}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:33 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-ade3c089-7901-49ba-a12f-ecd2dbafcade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257/action" status: 202 len: 52 microversion: 2.87 time: 1.170588 Apr 20 13:33:33 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 128/386] 10.0.0.210 () {66 vars in 1396 bytes} [Thu Apr 20 13:33:32 2023] POST /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257/action => generated 52 bytes in 1172 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:39 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:39 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:39 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:39 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-d52aae83-3c17-4b4c-91aa-652abde31a8b tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 200 len: 1691 microversion: 2.87 time: 0.241989 Apr 20 13:33:39 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 129/387] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:33:38 2023] GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 1691 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:49 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:49 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-0acdf630-af13-48ba-934d-e96a92934556 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 200 len: 1536 microversion: 2.1 time: 0.253280 Apr 20 13:33:49 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 131/388] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:33:49 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 1536 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Searching by: {'deleted': False, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394'} {{(pid=61279) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:49 user devstack@n-api.service[61279]: DEBUG nova.compute.multi_cell_list [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61279) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 13:33:49 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-177d13e1-bda2-4a5c-a583-4956ae8177c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.194538 Apr 20 13:33:49 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 13:33:49 2023] GET /compute/v2.1/servers => generated 340 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:49 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:50 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:50 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-4503f09c-41ab-4fb9-81a8-d1ca41cc13ca tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 200 len: 1536 microversion: 2.1 time: 0.216489 Apr 20 13:33:50 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 130/390] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:33:49 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 1536 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:51 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:33:51 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-44accc4c-0831-41b6-95e2-1ede232550f9 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 204 len: 0 microversion: 2.1 time: 0.138623 Apr 20 13:33:51 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 132/391] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:33:51 2023] DELETE /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:51 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:52 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "name": "network-vif-unplugged", "status": "completed", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:33:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] Creating event network-vif-unplugged:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:33:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-ffc24cd4-64fe-40f7-bb8d-6f32f3f3d5d5 req-42b23608-9b61-4662-8c9b-b3e74be6c4b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029893 Apr 20 13:33:52 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 131/392] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:33:52 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:33:52 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-bef7b73f-8fa1-42ba-84f1-a9d6a2a21091 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 200 len: 1542 microversion: 2.1 time: 0.605864 Apr 20 13:33:52 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 130/393] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:33:51 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 1542 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:33:52 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "name": "network-vif-deleted", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:33:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:52 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:53 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] Creating event network-vif-deleted:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:33:53 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-114f394c-42fe-4cdd-8607-16bea4d184df req-243bb233-f861-4ed5-a316-724e12b0d380 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092270 Apr 20 13:33:53 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 133/394] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:33:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:33:54 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e31cc14-cc22-4099-a456-da2a6384180c", "name": "network-vif-plugged", "status": "completed", "tag": "45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:33:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:33:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:33:54 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:33:54 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] Creating event network-vif-plugged:45bbc1b1-dc25-40b8-97d9-9d07cce7f3d6 for instance 9e31cc14-cc22-4099-a456-da2a6384180c on user Apr 20 13:33:54 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-47fbfae5-4322-4960-86e6-0cd654b4bbd3 req-9b09b4df-e887-4d57-bcdc-2129f33e4592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032816 Apr 20 13:33:54 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 132/395] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:33:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:34:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1589578196", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "7837d23e-834b-4e86-9a95-07696906c7f5", "destination_type": "volume"}], "networks": [{"uuid": "eae33ff8-4b9e-47ed-ae38-92bbb5103d34"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:39 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:39 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:39 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=14 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:39 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] validate_networks() for [('eae33ff8-4b9e-47ed-ae38-92bbb5103d34', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Getting quotas for user c3692be8cf1e4aaca3064315bd58925d and project 19f14421c983428b93a976cdf8328aaf. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:34:40 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:34:40 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-d95716c8-b80e-4f87-a1c9-38ce1c8aed08 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.034446 Apr 20 13:34:40 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 131/396] 10.0.0.210 () {66 vars in 1265 bytes} [Thu Apr 20 13:34:39 2023] POST /compute/v2.1/servers => generated 378 bytes in 1036 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:34:40 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:34:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-53bcfa5f-6f57-4267-9e8d-333b0e5bc55d tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482" status: 200 len: 1395 microversion: 2.87 time: 0.085271 Apr 20 13:34:40 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 134/397] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:34:40 2023] GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482 => generated 1395 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=10 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: 9e31cc14-cc22-4099-a456-da2a6384180c] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] HTTP exception thrown: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Request method failure captured: Apr 20 13:34:42 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c HTTP/1.1 Apr 20 13:34:42 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:34:42 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:34:42 user devstack@n-api.service[61278]: Connection: close Apr 20 13:34:42 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:34:42 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:34:42 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:34:42 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:34:42 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT7Dbid2tiFeXEZzNKvoL9MBtsfmHhZKsVoy81lgLUpRh-fXCZesKu_ZBAabYA3oY0nupDDavo2ANtH4LVE-D5vDGjiIaEvbhspYAqnjx_P4jkN4YjcfMtaYGihoJsTtHoDa6GgZcUErDdOUShfUujwQ7VpeOPF1gKmnhh7IoW_P1cQ Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Project-Id: 8ad7c3634b8a46acbbd9bd4c6abbd394 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Project-Name: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Tenant: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Tenant-Id: 8ad7c3634b8a46acbbd9bd4c6abbd394 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:34:42 user devstack@n-api.service[61278]: X-User: tempest-TestMinimumBasicScenario-399205810-project-member Apr 20 13:34:42 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:34:42 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:34:42 user devstack@n-api.service[61278]: X-User-Id: 91ff3a4e15a54a63821bd2a43041feda Apr 20 13:34:42 user devstack@n-api.service[61278]: X-User-Name: tempest-TestMinimumBasicScenario-399205810-project-member Apr 20 13:34:42 user devstack@n-api.service[61278]: method: > Apr 20 13:34:42 user devstack@n-api.service[61278]: exception: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. Apr 20 13:34:42 user devstack@n-api.service[61278]: action_args: {'id': '9e31cc14-cc22-4099-a456-da2a6384180c'} Apr 20 13:34:42 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. Apr 20 13:34:42 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:34:42 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Returning 404 to user: Instance 9e31cc14-cc22-4099-a456-da2a6384180c could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:34:42 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-497e32a9-44cd-4903-9905-38a5fcb96e5a tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c" status: 404 len: 111 microversion: 2.1 time: 0.040401 Apr 20 13:34:42 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 133/398] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:34:42 2023] GET /compute/v2.1/servers/9e31cc14-cc22-4099-a456-da2a6384180c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:34:42 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-222c8e55-4d01-4e9d-91e0-a6ca98c33fd7 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '.version_select at 0x7f31d9021b40>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:34:42 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-222c8e55-4d01-4e9d-91e0-a6ca98c33fd7 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-710722238" status: 202 len: 0 microversion: 2.1 time: 0.029079 Apr 20 13:34:42 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 132/399] 10.0.0.210 () {62 vars in 1346 bytes} [Thu Apr 20 13:34:42 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-710722238 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:34:42 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8503a9f-5618-4803-999f-f42299aa5482", "tag": "95a48a18-e58c-4e4e-a6d5-5bbd8481e3a9"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:42 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:42 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] Creating event network-changed:95a48a18-e58c-4e4e-a6d5-5bbd8481e3a9 for instance f8503a9f-5618-4803-999f-f42299aa5482 on user Apr 20 13:34:42 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-11d5fade-552a-441e-9967-e864b4dfcb11 req-3cea57c4-5822-4593-a5a8-e700a99b6f5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038712 Apr 20 13:34:42 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 135/400] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:34:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8503a9f-5618-4803-999f-f42299aa5482", "name": "network-vif-deleted", "tag": "95a48a18-e58c-4e4e-a6d5-5bbd8481e3a9"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:44 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:44 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.compute.server_external_events [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] Unable to find a host for instance f8503a9f-5618-4803-999f-f42299aa5482. Dropping event network-vif-deleted {{(pid=61278) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 20 13:34:44 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-f88e3481-e33d-4a04-83f9-c5cf941dd04c req-cf73049c-918b-48dd-b8f8-e5782f4e74a1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.029162 Apr 20 13:34:44 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 134/401] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:34:44 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 20 13:34:44 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a20ab3fc-9e9f-4590-9697-c3dff0400281 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Action: 'create', calling method: .version_select at 0x7f31d8f10160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1154622108", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2SFnOzet/Sr0/kLveyFXIknDQuwHU/xUkvEoQdvdBf7z0Y9ryKtHVy9zvjm2Coa/lYo4qbJyg0K/O0RbXt4esAglux8od8ee5/FDLyjAbet6+LZiJKGvE6RnHRibPPrg=="}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:44 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-a20ab3fc-9e9f-4590-9697-c3dff0400281 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:34:44 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-a20ab3fc-9e9f-4590-9697-c3dff0400281 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for user 91ff3a4e15a54a63821bd2a43041feda and project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'key_pairs'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:34:44 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a20ab3fc-9e9f-4590-9697-c3dff0400281 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.043274 Apr 20 13:34:44 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 133/402] 10.0.0.210 () {64 vars in 1236 bytes} [Thu Apr 20 13:34:44 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1121587856", "imageRef": "abcd9bf4-a378-412d-ad41-068ebe534268", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1154622108", "networks": [{"uuid": "16c48cbc-ac65-4bfe-afc7-c8d9e69d1a52"}]}} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] validate_networks() for [('16c48cbc-ac65-4bfe-afc7-c8d9e69d1a52', None, None, None, None, None)] {{(pid=61277) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Flavor limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Image limits 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Flavor pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Image pref 0:0:0 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.virt.hardware [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61277) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.quota [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Getting quotas for user 91ff3a4e15a54a63821bd2a43041feda and project 8ad7c3634b8a46acbbd9bd4c6abbd394. Resources: {'instances', 'ram', 'cores'} {{(pid=61277) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Going to run 1 instances... {{(pid=61277) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:34:45 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='abcd9bf4-a378-412d-ad41-068ebe534268',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61277) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:34:45 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-456437e8-329c-44ea-90cc-c59d12773bb6 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.650485 Apr 20 13:34:45 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 136/403] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:34:45 2023] POST /compute/v2.1/servers => generated 378 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:34:45 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-2c923000-3393-4b7b-8221-b246fd4d4099 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:34:45 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-2c923000-3393-4b7b-8221-b246fd4d4099 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:34:45 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-2c923000-3393-4b7b-8221-b246fd4d4099 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:34:45 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-2c923000-3393-4b7b-8221-b246fd4d4099 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 200 len: 1253 microversion: 2.1 time: 0.066797 Apr 20 13:34:45 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 135/404] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:34:45 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 1253 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:34:48 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:48 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] Creating event network-changed:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:34:48 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-0e911be0-882c-417d-b554-75de417de11b req-e3a1ebd0-4765-4e2a-ba6e-359528018057 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027062 Apr 20 13:34:48 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 134/405] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:34:50 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "name": "network-vif-plugged", "status": "completed", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:50 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:50 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] Creating event network-vif-plugged:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:34:50 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-5b1d267a-c50b-4c92-8ab4-2fecc01b38d1 req-d16c86a7-80d5-4c16-a833-fc4a05e472f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092201 Apr 20 13:34:50 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 137/406] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:34:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:34:52 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "name": "network-vif-plugged", "status": "completed", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:34:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:34:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:34:52 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:34:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] Creating event network-vif-plugged:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:34:52 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-ec2c2297-697a-40e7-b197-27baf2c6481c req-b5689c31-eb24-493f-ad37-775e503b9a03 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038106 Apr 20 13:34:52 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 136/407] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:34:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=10 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.objects.instance [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lazy-loading 'fault' on Instance uuid f8503a9f-5618-4803-999f-f42299aa5482 {{(pid=61279) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:30 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:30 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-e4831250-0ba1-4680-9ec3-0253a4504af2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482" status: 200 len: 1650 microversion: 2.87 time: 0.109385 Apr 20 13:35:30 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 135/408] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:35:30 2023] GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482 => generated 1650 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=8 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Going to try to terminate instance {{(pid=61277) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Doing local delete in cell db6d068e-9cbf-4ca5-a5c2-9826745af97f(cell1) {{(pid=61277) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:30 user devstack@n-api.service[61277]: WARNING nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] instance's host None is down, deleting from database Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] deallocate_for_instance() {{(pid=61277) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Instance cache missing network info. {{(pid=61277) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.network.neutron [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Updating instance_info_cache with network_info: [] {{(pid=61277) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 20 13:35:30 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61277) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 20 13:35:30 user devstack@n-api.service[61277]: WARNING nova.compute.api [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 20 13:35:31 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-70f94fe1-3399-4e98-8887-e11ccbe553fd tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482" status: 204 len: 0 microversion: 2.87 time: 0.770243 Apr 20 13:35:31 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 138/409] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:35:30 2023] DELETE /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482 => generated 0 bytes in 773 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=10 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: f8503a9f-5618-4803-999f-f42299aa5482] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] HTTP exception thrown: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Request method failure captured: Apr 20 13:35:31 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482 HTTP/1.1 Apr 20 13:35:31 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:35:31 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:35:31 user devstack@n-api.service[61278]: Connection: close Apr 20 13:35:31 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:35:31 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:35:31 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:35:31 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:35:31 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT3WgSEc6TkadZ3qvTGsQ7JBuFpeSqsDfM1uzfS0cjbEcix33v6SMe8SDo9yIjPbAIYW8apraZ1623uZmWssOxzBHyAzUtcGyPSMCTjjsc4tJJ2D8dWXDbHULG7Gz-r2mLjpVofNh8ujjaGcq_f6ZKmHS_Vl-nAgDnTSLkJG_g2mgP0 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Project-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Tenant-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:35:31 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:35:31 user devstack@n-api.service[61278]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:35:31 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:35:31 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:35:31 user devstack@n-api.service[61278]: X-User-Id: c3692be8cf1e4aaca3064315bd58925d Apr 20 13:35:31 user devstack@n-api.service[61278]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:35:31 user devstack@n-api.service[61278]: method: > Apr 20 13:35:31 user devstack@n-api.service[61278]: exception: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. Apr 20 13:35:31 user devstack@n-api.service[61278]: action_args: {'id': 'f8503a9f-5618-4803-999f-f42299aa5482'} Apr 20 13:35:31 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. Apr 20 13:35:31 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Returning 404 to user: Instance f8503a9f-5618-4803-999f-f42299aa5482 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:35:31 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-9576b362-137d-4374-96d3-a9dea7391519 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482" status: 404 len: 111 microversion: 2.87 time: 0.035702 Apr 20 13:35:31 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 137/410] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:35:31 2023] GET /compute/v2.1/servers/f8503a9f-5618-4803-999f-f42299aa5482 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:35:31 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-8e238d33-4271-4b9b-a91f-ee86f809ef80 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 204 len: 0 microversion: 2.87 time: 0.108798 Apr 20 13:35:31 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 136/411] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:35:31 2023] DELETE /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "name": "network-vif-unplugged", "status": "completed", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:31 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:32 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] Creating event network-vif-unplugged:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:35:32 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-71153981-db51-41ce-ba82-d4e242c94cab req-b8eae41f-cab5-4923-8c10-a3ca8dc68aa5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029901 Apr 20 13:35:32 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 138/412] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:35:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:35:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:32 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:32 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-7c318c3d-fa8e-4cf1-a86f-f785fb36e2a1 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 200 len: 1697 microversion: 2.87 time: 0.286352 Apr 20 13:35:32 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 139/413] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:35:31 2023] GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 1697 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:35:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "name": "network-vif-deleted", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:35:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:33 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] Creating event network-vif-deleted:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:35:33 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-f87e9c38-fe8e-41fb-94c7-d82ec14100d5 req-25907a32-49ed-41ad-a0b7-39a61ca4eeaa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038479 Apr 20 13:35:33 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 137/414] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:35:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:35:34 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155b0807-9ebf-4338-9baa-b5b2854d6257", "name": "network-vif-plugged", "status": "completed", "tag": "1b0fefe4-e415-4c01-9cdf-a60fd2c9e467"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:35:34 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:34 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:34 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:34 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] Creating event network-vif-plugged:1b0fefe4-e415-4c01-9cdf-a60fd2c9e467 for instance 155b0807-9ebf-4338-9baa-b5b2854d6257 on user Apr 20 13:35:34 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-a7934fa8-e443-43e6-99f2-0d867a7a15fa req-cf94d731-b3d1-40fc-ad86-7abc4572992c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045888 Apr 20 13:35:34 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 139/415] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:35:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:35:35 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:35:36 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:35:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-c3d6c8d3-e6d7-4e83-b4d3-98dc997740c0 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 200 len: 1537 microversion: 2.1 time: 0.226350 Apr 20 13:35:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 140/416] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:35:35 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 1537 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 155b0807-9ebf-4338-9baa-b5b2854d6257] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] HTTP exception thrown: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Request method failure captured: Apr 20 13:36:22 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 HTTP/1.1 Apr 20 13:36:22 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:36:22 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:36:22 user devstack@n-api.service[61279]: Connection: close Apr 20 13:36:22 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:36:22 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:36:22 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:36:22 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:36:22 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT3WgSEc6TkadZ3qvTGsQ7JBuFpeSqsDfM1uzfS0cjbEcix33v6SMe8SDo9yIjPbAIYW8apraZ1623uZmWssOxzBHyAzUtcGyPSMCTjjsc4tJJ2D8dWXDbHULG7Gz-r2mLjpVofNh8ujjaGcq_f6ZKmHS_Vl-nAgDnTSLkJG_g2mgP0 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Project-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Tenant-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:36:22 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:36:22 user devstack@n-api.service[61279]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:36:22 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:36:22 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:36:22 user devstack@n-api.service[61279]: X-User-Id: c3692be8cf1e4aaca3064315bd58925d Apr 20 13:36:22 user devstack@n-api.service[61279]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:36:22 user devstack@n-api.service[61279]: method: > Apr 20 13:36:22 user devstack@n-api.service[61279]: exception: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. Apr 20 13:36:22 user devstack@n-api.service[61279]: action_args: {'id': '155b0807-9ebf-4338-9baa-b5b2854d6257'} Apr 20 13:36:22 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. Apr 20 13:36:22 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Returning 404 to user: Instance 155b0807-9ebf-4338-9baa-b5b2854d6257 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:36:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-626878e6-c808-4031-8ab8-47ccc629dade tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257" status: 404 len: 111 microversion: 2.87 time: 0.037562 Apr 20 13:36:22 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 138/417] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:36:22 2023] GET /compute/v2.1/servers/155b0807-9ebf-4338-9baa-b5b2854d6257 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:36:22 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-049960b6-0585-49a9-bf6b-de40d5369d71 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 204 len: 0 microversion: 2.87 time: 0.131063 Apr 20 13:36:22 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 140/418] 10.0.0.210 () {64 vars in 1357 bytes} [Thu Apr 20 13:36:22 2023] DELETE /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:22 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c3692be8cf1e4aaca3064315bd58925d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19f14421c983428b93a976cdf8328aaf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:22 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-29a19278-06ad-479c-87d6-7b5e02f030b2 tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 200 len: 1698 microversion: 2.87 time: 0.273724 Apr 20 13:36:22 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 141/419] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:36:22 2023] GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 1698 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "name": "network-vif-unplugged", "status": "completed", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:22 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] Creating event network-vif-unplugged:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:36:22 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-ed3e5f27-9039-400e-b0db-0586420d17e5 req-398e9df7-3240-47fe-acd0-d76d46f4356e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029670 Apr 20 13:36:22 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:22 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:23 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "name": "network-vif-deleted", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:23 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:23 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] Creating event network-vif-deleted:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:36:23 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-b4edb829-e0fd-4611-92f4-397289e93c74 req-9876deea-6170-47dd-995d-2706c5a90ce8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029020 Apr 20 13:36:23 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 141/421] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:24 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "588f6683-2a3b-4443-aed5-64d1d67f62cf", "name": "network-vif-plugged", "status": "completed", "tag": "ea52522b-6b80-427f-a41a-d1d7afc28d41"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:24 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] Creating event network-vif-plugged:ea52522b-6b80-427f-a41a-d1d7afc28d41 for instance 588f6683-2a3b-4443-aed5-64d1d67f62cf on user Apr 20 13:36:24 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-4d7475c0-e77b-4744-b46c-9522af051d41 req-b02d4042-172c-4773-8196-135d0752f7bd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028774 Apr 20 13:36:24 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 142/422] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=4 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:36 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-0ad2c742-3f0b-4f54-9abf-ad3a2a447d1b tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 200 len: 1537 microversion: 2.1 time: 0.233311 Apr 20 13:36:36 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:36:36 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Searching by: {'deleted': False, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394'} {{(pid=61278) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61278]: DEBUG nova.compute.multi_cell_list [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61278) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 20 13:36:36 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-dab55872-c0d0-4823-b210-7ec7529ad21c tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.191985 Apr 20 13:36:36 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 142/424] 10.0.0.210 () {62 vars in 1202 bytes} [Thu Apr 20 13:36:36 2023] GET /compute/v2.1/servers => generated 341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=8 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:36 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:36 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-d4839e4d-a209-4d66-a3ef-3273293811ae tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 200 len: 1537 microversion: 2.1 time: 0.225227 Apr 20 13:36:36 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 143/425] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:36:36 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 1537 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:38 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:36:38 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-6a5d2044-c9ae-4d89-b92f-b6a023c7f226 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 204 len: 0 microversion: 2.1 time: 0.112687 Apr 20 13:36:38 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:36:38 2023] DELETE /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:38 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "name": "network-vif-unplugged", "status": "completed", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:38 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:38 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:38 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:38 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] Creating event network-vif-unplugged:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:36:38 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-ee1e60ac-d3a2-4958-9c95-e18ec839177c req-49b3b745-92cf-491c-b0dc-d2278ec2e19e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043499 Apr 20 13:36:38 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 144/427] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:38 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91ff3a4e15a54a63821bd2a43041feda', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ad7c3634b8a46acbbd9bd4c6abbd394', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:36:38 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-0005ea07-471e-4c74-91e9-4e9e452edb09 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 200 len: 1543 microversion: 2.1 time: 0.292744 Apr 20 13:36:38 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:36:38 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 1543 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:36:39 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "name": "network-vif-deleted", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:39 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] Creating event network-vif-deleted:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:36:39 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-ca4adb86-074c-4496-a359-b28025d5f730 req-f8e8a0d0-28ca-4a31-a521-1a3a0f432c38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033167 Apr 20 13:36:39 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:36:40 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b448f0-86e8-4931-a5e9-ea2c14d97112", "name": "network-vif-plugged", "status": "completed", "tag": "6f6642f7-604c-4267-a864-d16863c940f6"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:36:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:36:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:36:40 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:36:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] Creating event network-vif-plugged:6f6642f7-604c-4267-a864-d16863c940f6 for instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 on user Apr 20 13:36:40 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-7dc9b0b0-5c95-437e-989d-0e10f32be65f req-faef80cd-c0c3-4c7e-8821-a831e6314344 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029172 Apr 20 13:36:40 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 145/430] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:36:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=14 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] [instance: 588f6683-2a3b-4443-aed5-64d1d67f62cf] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:12 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] HTTP exception thrown: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Request method failure captured: Apr 20 13:37:12 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf HTTP/1.1 Apr 20 13:37:12 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:37:12 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:37:12 user devstack@n-api.service[61278]: Connection: close Apr 20 13:37:12 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:37:12 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:37:12 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:37:12 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:37:12 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQT3WgSEc6TkadZ3qvTGsQ7JBuFpeSqsDfM1uzfS0cjbEcix33v6SMe8SDo9yIjPbAIYW8apraZ1623uZmWssOxzBHyAzUtcGyPSMCTjjsc4tJJ2D8dWXDbHULG7Gz-r2mLjpVofNh8ujjaGcq_f6ZKmHS_Vl-nAgDnTSLkJG_g2mgP0 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Openstack-Nova-Api-Version: 2.87 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Project-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/19f14421c983428b93a976cdf8328aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Tenant-Id: 19f14421c983428b93a976cdf8328aaf Apr 20 13:37:12 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511 Apr 20 13:37:12 user devstack@n-api.service[61278]: X-User: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:37:12 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:37:12 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:37:12 user devstack@n-api.service[61278]: X-User-Id: c3692be8cf1e4aaca3064315bd58925d Apr 20 13:37:12 user devstack@n-api.service[61278]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member Apr 20 13:37:12 user devstack@n-api.service[61278]: method: > Apr 20 13:37:12 user devstack@n-api.service[61278]: exception: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. Apr 20 13:37:12 user devstack@n-api.service[61278]: action_args: {'id': '588f6683-2a3b-4443-aed5-64d1d67f62cf'} Apr 20 13:37:12 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. Apr 20 13:37:12 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:37:12 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] Returning 404 to user: Instance 588f6683-2a3b-4443-aed5-64d1d67f62cf could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:37:12 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-1f33510b-3fea-425b-a284-94ac6837326f tempest-ServerBootFromVolumeStableRescueTest-1206275511 tempest-ServerBootFromVolumeStableRescueTest-1206275511-project-member] 10.0.0.210 "GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf" status: 404 len: 111 microversion: 2.87 time: 0.044715 Apr 20 13:37:12 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 144/431] 10.0.0.210 () {64 vars in 1354 bytes} [Thu Apr 20 13:37:12 2023] GET /compute/v2.1/servers/588f6683-2a3b-4443-aed5-64d1d67f62cf => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 20 13:37:24 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:24 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:24 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1563328358", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "bf0a2e7b-8bea-45ce-980f-da31388cd29a"}]}} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.network.neutron [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] validate_networks() for [('bf0a2e7b-8bea-45ce-980f-da31388cd29a', None, None, None, None, None)] {{(pid=61279) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Flavor limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Image limits 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Flavor pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Image pref 0:0:0 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.virt.hardware [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61279) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Getting quotas for project 5b14d9323d644570a9d07c6e22fe74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.quota [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Getting quotas for user 4a2072628bc5432fbe2563643e1cea0e and project 5b14d9323d644570a9d07c6e22fe74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61279) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Going to run 1 instances... {{(pid=61279) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:37:25 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61279) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:37:25 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-206b8932-9ce5-4da3-a373-04452e84b4d9 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.839200 Apr 20 13:37:25 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 143/432] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:37:24 2023] POST /compute/v2.1/servers => generated 378 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:37:25 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:25 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=10 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:25 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-2ba62931-d8a3-4db0-9f25-1800e16d8148 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:37:25 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-2ba62931-d8a3-4db0-9f25-1800e16d8148 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:37:25 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-2ba62931-d8a3-4db0-9f25-1800e16d8148 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:37:25 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-2ba62931-d8a3-4db0-9f25-1800e16d8148 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1211 microversion: 2.1 time: 0.076184 Apr 20 13:37:25 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 146/433] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:37:25 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1211 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:28 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:28 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] Creating event network-changed:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:37:28 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-f2f5a5aa-c2bc-45ab-b51b-203fbd13618d req-043dc8ee-eb2e-47b9-b464-7749078fb85a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038070 Apr 20 13:37:28 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 145/434] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:37:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] [instance: e8b448f0-86e8-4931-a5e9-ea2c14d97112] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:28 user devstack@n-api.service[61279]: INFO nova.api.openstack.wsgi [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] HTTP exception thrown: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Request method failure captured: Apr 20 13:37:28 user devstack@n-api.service[61279]: request: GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 HTTP/1.1 Apr 20 13:37:28 user devstack@n-api.service[61279]: Accept: application/json Apr 20 13:37:28 user devstack@n-api.service[61279]: Accept-Encoding: identity Apr 20 13:37:28 user devstack@n-api.service[61279]: Connection: close Apr 20 13:37:28 user devstack@n-api.service[61279]: Content-Length: 0 Apr 20 13:37:28 user devstack@n-api.service[61279]: Content-Type: application/json Apr 20 13:37:28 user devstack@n-api.service[61279]: Host: 10.0.0.210 Apr 20 13:37:28 user devstack@n-api.service[61279]: Openstack-System-Scope: None Apr 20 13:37:28 user devstack@n-api.service[61279]: User-Agent: python-urllib3/1.26.15 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Auth-Token: gAAAAABkQT7Dbid2tiFeXEZzNKvoL9MBtsfmHhZKsVoy81lgLUpRh-fXCZesKu_ZBAabYA3oY0nupDDavo2ANtH4LVE-D5vDGjiIaEvbhspYAqnjx_P4jkN4YjcfMtaYGihoJsTtHoDa6GgZcUErDdOUShfUujwQ7VpeOPF1gKmnhh7IoW_P1cQ Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Domain-Id: None Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Domain-Name: None Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Identity-Status: Confirmed Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Is-Admin-Project: True Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Project-Domain-Id: default Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Project-Domain-Name: Default Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Project-Id: 8ad7c3634b8a46acbbd9bd4c6abbd394 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Project-Name: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Role: member,reader Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Roles: member,reader Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8ad7c3634b8a46acbbd9bd4c6abbd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Tenant: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Tenant-Id: 8ad7c3634b8a46acbbd9bd4c6abbd394 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-Tenant-Name: tempest-TestMinimumBasicScenario-399205810 Apr 20 13:37:28 user devstack@n-api.service[61279]: X-User: tempest-TestMinimumBasicScenario-399205810-project-member Apr 20 13:37:28 user devstack@n-api.service[61279]: X-User-Domain-Id: default Apr 20 13:37:28 user devstack@n-api.service[61279]: X-User-Domain-Name: Default Apr 20 13:37:28 user devstack@n-api.service[61279]: X-User-Id: 91ff3a4e15a54a63821bd2a43041feda Apr 20 13:37:28 user devstack@n-api.service[61279]: X-User-Name: tempest-TestMinimumBasicScenario-399205810-project-member Apr 20 13:37:28 user devstack@n-api.service[61279]: method: > Apr 20 13:37:28 user devstack@n-api.service[61279]: exception: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. Apr 20 13:37:28 user devstack@n-api.service[61279]: action_args: {'id': 'e8b448f0-86e8-4931-a5e9-ea2c14d97112'} Apr 20 13:37:28 user devstack@n-api.service[61279]: {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. Apr 20 13:37:28 user devstack@n-api.service[61279]: ERROR nova.api.openstack.wsgi Apr 20 13:37:28 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Returning 404 to user: Instance e8b448f0-86e8-4931-a5e9-ea2c14d97112 could not be found. {{(pid=61279) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:37:28 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-a396e85a-f284-47d2-9f87-2779c3114b81 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112" status: 404 len: 111 microversion: 2.1 time: 0.122506 Apr 20 13:37:28 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:37:28 2023] GET /compute/v2.1/servers/e8b448f0-86e8-4931-a5e9-ea2c14d97112 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:37:28 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-4938d8b3-91d1-4812-af9c-a8a651c519c8 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] Calling method '.version_select at 0x7f31d8f24ee0>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:37:28 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-4938d8b3-91d1-4812-af9c-a8a651c519c8 tempest-TestMinimumBasicScenario-399205810 tempest-TestMinimumBasicScenario-399205810-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1154622108" status: 202 len: 0 microversion: 2.1 time: 0.023679 Apr 20 13:37:28 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 147/436] 10.0.0.210 () {62 vars in 1349 bytes} [Thu Apr 20 13:37:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1154622108 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 20 13:37:30 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "name": "network-vif-plugged", "status": "completed", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:37:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:30 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] Creating event network-vif-plugged:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:37:30 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-fdadf40b-f6ea-4ace-b15f-2c9d5225af4d req-7955b5d4-328e-4cd6-9753-2d3a204d8682 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065356 Apr 20 13:37:30 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 146/437] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:37:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:37:32 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "name": "network-vif-plugged", "status": "completed", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:37:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:37:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:37:32 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:37:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] Creating event network-vif-plugged:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:37:32 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-c684e4ca-2fb8-456e-9bb0-51942fbab0b2 req-9e74b7dd-7ae7-4ffb-b3d0-e7495f137c6f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028828 Apr 20 13:37:32 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 145/438] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:37:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell0:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:38:15 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:38:16 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:38:16 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-fe8db22d-5ee4-491c-9dba-6a63bcfbf5e8 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1495 microversion: 2.1 time: 0.387733 Apr 20 13:38:16 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 148/439] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:38:15 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1495 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:39:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:16 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:16 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:39:16 user devstack@n-api.service[61278]: Thu Apr 20 13:39:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 13:39:16 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:39:16 user devstack@n-api.service[61278]: Thu Apr 20 13:39:16 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.0.0.210) !!! Apr 20 13:39:16 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-296502839", "imageRef": "7837d23e-834b-4e86-9a95-07696906c7f5", "flavorRef": "42", "networks": [{"uuid": "bf0a2e7b-8bea-45ce-980f-da31388cd29a"}]}} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:39:16 user devstack@n-api.service[61278]: DEBUG nova.network.neutron [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] validate_networks() for [('bf0a2e7b-8bea-45ce-980f-da31388cd29a', None, None, None, None, None)] {{(pid=61278) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Flavor limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Image limits 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Flavor pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Image pref 0:0:0 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.virt.hardware [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61278) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Getting quotas for project 5b14d9323d644570a9d07c6e22fe74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.quota [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Getting quotas for user 4a2072628bc5432fbe2563643e1cea0e and project 5b14d9323d644570a9d07c6e22fe74ed. Resources: {'instances', 'ram', 'cores'} {{(pid=61278) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Going to run 1 instances... {{(pid=61278) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 20 13:39:17 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7837d23e-834b-4e86-9a95-07696906c7f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61278) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 20 13:39:17 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-a11b2328-a705-4f7b-af7c-053c71c06f83 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.813633 Apr 20 13:39:17 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 147/440] 10.0.0.210 () {64 vars in 1224 bytes} [Thu Apr 20 13:39:16 2023] POST /compute/v2.1/servers => generated 378 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-b5394ac2-b687-46ae-abff-fc4d66fe8258 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-b5394ac2-b687-46ae-abff-fc4d66fe8258 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:39:17 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-b5394ac2-b687-46ae-abff-fc4d66fe8258 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:39:17 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-b5394ac2-b687-46ae-abff-fc4d66fe8258 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 200 len: 1210 microversion: 2.1 time: 0.073654 Apr 20 13:39:17 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 146/441] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:39:17 2023] GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 1210 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:39:19 user devstack@n-api.service[61277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:39:19 user devstack@n-api.service[61277]: Thu Apr 20 13:39:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 13:39:19 user devstack@n-api.service[61277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:39:19 user devstack@n-api.service[61277]: Thu Apr 20 13:39:19 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:39:19 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:39:19 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] Creating event network-changed:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:39:19 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-dbe955b5-2ca5-44ec-bccc-8553f8f080e4 req-a0f67ade-4ab8-4919-9736-c176ffeb99d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097422 Apr 20 13:39:19 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 149/442] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:39:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:39:21 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "name": "network-vif-plugged", "status": "completed", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:39:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:39:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:39:21 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:39:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] Creating event network-vif-plugged:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:39:21 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-e405ba8d-196c-4bb0-a721-f7da3467857c req-b46c5eff-b2f5-4802-82da-c12c6cc031d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032194 Apr 20 13:39:21 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 148/443] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:39:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:39:23 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "name": "network-vif-plugged", "status": "completed", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:39:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:39:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:39:23 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:39:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] Creating event network-vif-plugged:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:39:23 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-c876b8e7-927a-47ae-b3d3-4ebe41026834 req-50b963ed-88cb-4087-b024-f5e90c7b10d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039982 Apr 20 13:39:23 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 147/444] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:39:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:40:07 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:40:07 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-a918cd01-feca-4729-9685-9f947bfc2419 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 200 len: 1493 microversion: 2.1 time: 0.247801 Apr 20 13:40:07 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 150/445] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:40:07 2023] GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 1493 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell0:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:07 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Going to try to terminate instance {{(pid=61278) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:41:07 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-11a2b232-f6d7-4526-934d-cd67932543e5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 204 len: 0 microversion: 2.1 time: 0.139961 Apr 20 13:41:07 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 149/446] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:41:07 2023] DELETE /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell0:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:41:07 user devstack@n-api.service[61279]: Thu Apr 20 13:41:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 (ip 10.0.0.210) !!! Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:07 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "name": "network-vif-unplugged", "status": "completed", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:07 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:07 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] Creating event network-vif-unplugged:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:41:07 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-83cecdbf-a2bd-4a40-aac3-f5a4f3ff86e0 req-955fd268-53f8-49e3-a334-56b355190df9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038275 Apr 20 13:41:07 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 151/447] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:41:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:41:08 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:41:08 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-802f0a34-7575-41f1-a36c-a7510f38b778 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 200 len: 1499 microversion: 2.1 time: 0.362299 Apr 20 13:41:08 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 148/448] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:41:07 2023] GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 1499 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 20 13:41:09 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "name": "network-vif-plugged", "status": "completed", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}, {"server_uuid": "2739a451-0e80-44bc-a9cd-05c11a689379", "name": "network-vif-deleted", "tag": "db2b2cc6-35e9-4321-bd6c-645761642f15"}]} {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:41:09 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:10 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:10 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:10 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Creating event network-vif-plugged:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:41:10 user devstack@n-api.service[61278]: INFO nova.api.openstack.compute.server_external_events [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] Creating event network-vif-deleted:db2b2cc6-35e9-4321-bd6c-645761642f15 for instance 2739a451-0e80-44bc-a9cd-05c11a689379 on user Apr 20 13:41:10 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [req-3d75c9f3-3819-4912-bfe0-6022f164c049 req-e025e83a-4115-4c00-a445-ea2d2bc4d230 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031912 Apr 20 13:41:10 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 150/449] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:41:09 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] HTTP exception thrown: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Request method failure captured: Apr 20 13:41:58 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 HTTP/1.1 Apr 20 13:41:58 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:41:58 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:41:58 user devstack@n-api.service[61277]: Connection: close Apr 20 13:41:58 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:41:58 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:41:58 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:41:58 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:41:58 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQUAUCfZJj_tZjJ1wtOXUypr8Hb-zS0u5TuaTMnLx0bhGeEY51nt7UMrIQG4NMBaSkxYVEl8YOFLedvFn_meBV4RPxXYTvXTsvBgqQCwMG0koUO5QId3UaA8QO3auqWO_9bFaAi9jkpw98i3UEBlckxd5JMrpkBFyJITgge8Hss15d-U Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Project-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Project-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Tenant: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Tenant-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:41:58 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:41:58 user devstack@n-api.service[61277]: X-User: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:41:58 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:41:58 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:41:58 user devstack@n-api.service[61277]: X-User-Id: 4a2072628bc5432fbe2563643e1cea0e Apr 20 13:41:58 user devstack@n-api.service[61277]: X-User-Name: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:41:58 user devstack@n-api.service[61277]: method: > Apr 20 13:41:58 user devstack@n-api.service[61277]: exception: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:41:58 user devstack@n-api.service[61277]: action_args: {'id': '2739a451-0e80-44bc-a9cd-05c11a689379'} Apr 20 13:41:58 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:41:58 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:41:58 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Returning 404 to user: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:41:58 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-f6f81eca-6e7d-4e6d-a7c0-3019d81eee88 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 404 len: 111 microversion: 2.1 time: 0.036792 Apr 20 13:41:58 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 152/450] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:41:58 2023] GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:41:58 user devstack@n-api.service[61279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 13:41:58 user devstack@n-api.service[61279]: Thu Apr 20 13:41:58 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:41:58 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:41:58 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-6b839af6-89c2-4f20-886f-216743f4c6b5 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1495 microversion: 2.1 time: 0.250752 Apr 20 13:41:58 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 149/451] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:41:58 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1495 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:43:00 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:43:00 user devstack@n-api.service[61278]: Thu Apr 20 13:43:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:43:00 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:43:00 user devstack@n-api.service[61278]: Thu Apr 20 13:43:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:43:00 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:43:00 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-917dae8e-cc4b-46e6-8a51-bc410a961725 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1495 microversion: 2.1 time: 0.277946 Apr 20 13:43:00 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 151/452] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:43:00 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1495 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:44:00 user devstack@n-api.service[61277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:44:00 user devstack@n-api.service[61277]: Thu Apr 20 13:44:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:44:00 user devstack@n-api.service[61277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:44:00 user devstack@n-api.service[61277]: Thu Apr 20 13:44:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:44:00 user devstack@n-api.service[61277]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:44:00 user devstack@n-api.service[61277]: Thu Apr 20 13:44:00 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:44:00 user devstack@n-api.service[61277]: DEBUG nova.policy [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61277) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:44:00 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-37b2f1e1-35a9-4164-8b5e-d49b9a74875c tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1495 microversion: 2.1 time: 0.312790 Apr 20 13:44:00 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 153/453] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:44:00 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1495 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:45:02 user devstack@n-api.service[61279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:45:02 user devstack@n-api.service[61279]: Thu Apr 20 13:45:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:45:02 user devstack@n-api.service[61279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:45:02 user devstack@n-api.service[61279]: Thu Apr 20 13:45:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:45:02 user devstack@n-api.service[61279]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 13:45:02 user devstack@n-api.service[61279]: Thu Apr 20 13:45:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 (ip 10.0.0.210) !!! Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:45:02 user devstack@n-api.service[61279]: DEBUG nova.policy [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61279) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:45:02 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-f057944d-57c3-4573-a893-9ac5ef87c99e tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1495 microversion: 2.1 time: 0.403818 Apr 20 13:45:02 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 150/454] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:45:02 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1495 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=2 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=6 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:02 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 20 13:46:02 user devstack@n-api.service[61278]: Thu Apr 20 13:46:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 (ip 10.0.0.210) !!! Apr 20 13:46:02 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 13:46:02 user devstack@n-api.service[61278]: Thu Apr 20 13:46:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 (ip 10.0.0.210) !!! Apr 20 13:46:02 user devstack@n-api.service[61278]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 20 13:46:02 user devstack@n-api.service[61278]: Thu Apr 20 13:46:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 (ip 10.0.0.210) !!! Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:02 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] HTTP exception thrown: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Request method failure captured: Apr 20 13:46:03 user devstack@n-api.service[61278]: request: DELETE /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 HTTP/1.1 Apr 20 13:46:03 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:46:03 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:46:03 user devstack@n-api.service[61278]: Connection: close Apr 20 13:46:03 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:46:03 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:46:03 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:46:03 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:46:03 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQUAUCfZJj_tZjJ1wtOXUypr8Hb-zS0u5TuaTMnLx0bhGeEY51nt7UMrIQG4NMBaSkxYVEl8YOFLedvFn_meBV4RPxXYTvXTsvBgqQCwMG0koUO5QId3UaA8QO3auqWO_9bFaAi9jkpw98i3UEBlckxd5JMrpkBFyJITgge8Hss15d-U Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Project-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Project-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Tenant: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Tenant-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:03 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61278]: X-User: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:03 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:46:03 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:46:03 user devstack@n-api.service[61278]: X-User-Id: 4a2072628bc5432fbe2563643e1cea0e Apr 20 13:46:03 user devstack@n-api.service[61278]: X-User-Name: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:03 user devstack@n-api.service[61278]: method: > Apr 20 13:46:03 user devstack@n-api.service[61278]: exception: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61278]: action_args: {'id': '2739a451-0e80-44bc-a9cd-05c11a689379'} Apr 20 13:46:03 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Returning 404 to user: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:46:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-5b3b01c5-5db5-498b-b55a-f13350c09b1b tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 404 len: 111 microversion: 2.1 time: 0.066254 Apr 20 13:46:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 152/455] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:46:02 2023] DELETE /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_api:SELECT=2 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG dbcounter [-] [61277] Writing DB stats nova_cell1:SELECT=6 {{(pid=61277) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG nova.compute.api [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 2739a451-0e80-44bc-a9cd-05c11a689379] Fetching instance by UUID {{(pid=61277) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.wsgi [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] HTTP exception thrown: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Request method failure captured: Apr 20 13:46:03 user devstack@n-api.service[61277]: request: GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 HTTP/1.1 Apr 20 13:46:03 user devstack@n-api.service[61277]: Accept: application/json Apr 20 13:46:03 user devstack@n-api.service[61277]: Accept-Encoding: identity Apr 20 13:46:03 user devstack@n-api.service[61277]: Connection: close Apr 20 13:46:03 user devstack@n-api.service[61277]: Content-Length: 0 Apr 20 13:46:03 user devstack@n-api.service[61277]: Content-Type: application/json Apr 20 13:46:03 user devstack@n-api.service[61277]: Host: 10.0.0.210 Apr 20 13:46:03 user devstack@n-api.service[61277]: Openstack-System-Scope: None Apr 20 13:46:03 user devstack@n-api.service[61277]: User-Agent: python-urllib3/1.26.15 Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Auth-Token: gAAAAABkQUAUCfZJj_tZjJ1wtOXUypr8Hb-zS0u5TuaTMnLx0bhGeEY51nt7UMrIQG4NMBaSkxYVEl8YOFLedvFn_meBV4RPxXYTvXTsvBgqQCwMG0koUO5QId3UaA8QO3auqWO_9bFaAi9jkpw98i3UEBlckxd5JMrpkBFyJITgge8Hss15d-U Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Domain-Id: None Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Domain-Name: None Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Identity-Status: Confirmed Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Is-Admin-Project: True Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Project-Domain-Id: default Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Project-Domain-Name: Default Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Project-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Project-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Role: member,reader Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Roles: member,reader Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Tenant: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Tenant-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:03 user devstack@n-api.service[61277]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:03 user devstack@n-api.service[61277]: X-User: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:03 user devstack@n-api.service[61277]: X-User-Domain-Id: default Apr 20 13:46:03 user devstack@n-api.service[61277]: X-User-Domain-Name: Default Apr 20 13:46:03 user devstack@n-api.service[61277]: X-User-Id: 4a2072628bc5432fbe2563643e1cea0e Apr 20 13:46:03 user devstack@n-api.service[61277]: X-User-Name: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:03 user devstack@n-api.service[61277]: method: > Apr 20 13:46:03 user devstack@n-api.service[61277]: exception: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61277]: action_args: {'id': '2739a451-0e80-44bc-a9cd-05c11a689379'} Apr 20 13:46:03 user devstack@n-api.service[61277]: {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. Apr 20 13:46:03 user devstack@n-api.service[61277]: ERROR nova.api.openstack.wsgi Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Returning 404 to user: Instance 2739a451-0e80-44bc-a9cd-05c11a689379 could not be found. {{(pid=61277) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:46:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [None req-a32221c8-97ae-4be9-96d9-cc1c01be85a1 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379" status: 404 len: 111 microversion: 2.1 time: 0.034844 Apr 20 13:46:03 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 154/456] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:46:03 2023] GET /compute/v2.1/servers/2739a451-0e80-44bc-a9cd-05c11a689379 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61279) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_api:SELECT=2 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG dbcounter [-] [61279] Writing DB stats nova_cell1:SELECT=6 {{(pid=61279) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61279]: DEBUG nova.compute.api [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Going to try to terminate instance {{(pid=61279) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 20 13:46:03 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [None req-8c7c7d1e-8bd6-4733-ba1e-103ccf18bd05 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 204 len: 0 microversion: 2.1 time: 0.125631 Apr 20 13:46:03 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 151/457] 10.0.0.210 () {62 vars in 1316 bytes} [Thu Apr 20 13:46:03 2023] DELETE /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG nova.api.openstack.wsgi [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "name": "network-vif-unplugged", "status": "completed", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}]} {{(pid=61277) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:03 user devstack@n-api.service[61277]: DEBUG oslo_concurrency.lockutils [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61277) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:03 user devstack@n-api.service[61278]: DEBUG nova.policy [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a2072628bc5432fbe2563643e1cea0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b14d9323d644570a9d07c6e22fe74ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61278) authorize /opt/stack/nova/nova/policy.py:203}} Apr 20 13:46:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.compute.server_external_events [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] Creating event network-vif-unplugged:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:46:03 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-bdc7d346-a173-49fd-ad02-d1af1d3b9e99 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 200 len: 1501 microversion: 2.1 time: 0.302950 Apr 20 13:46:03 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 153/458] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:46:03 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 1501 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 20 13:46:03 user devstack@n-api.service[61277]: INFO nova.api.openstack.requestlog [req-31b82ed3-077c-4a7a-98aa-73743f0515fc req-3a649c63-69bd-45d7-99dc-130fb856d612 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085291 Apr 20 13:46:03 user devstack@n-api.service[61277]: [pid: 61277|app: 0|req: 155/459] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:46:05 user devstack@n-api.service[61279]: DEBUG nova.api.openstack.wsgi [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "name": "network-vif-plugged", "status": "completed", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}, {"server_uuid": "0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4", "name": "network-vif-deleted", "tag": "bb3b55ac-b201-4c7f-85fd-6e339e131a7f"}]} {{(pid=61279) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 20 13:46:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:05 user devstack@n-api.service[61279]: DEBUG oslo_concurrency.lockutils [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61279) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:05 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Creating event network-vif-plugged:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:46:05 user devstack@n-api.service[61279]: INFO nova.api.openstack.compute.server_external_events [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] Creating event network-vif-deleted:bb3b55ac-b201-4c7f-85fd-6e339e131a7f for instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 on user Apr 20 13:46:05 user devstack@n-api.service[61279]: INFO nova.api.openstack.requestlog [req-3ddd4faa-2619-4360-a9ba-050a6b003f8e req-3265fc79-1463-4baa-9c9b-94a8c3c5d162 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030812 Apr 20 13:46:05 user devstack@n-api.service[61279]: [pid: 61279|app: 0|req: 152/460] 10.0.0.210 () {68 vars in 1394 bytes} [Thu Apr 20 13:46:05 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Calling method '>' {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG nova.compute.api [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] [instance: 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4] Fetching instance by UUID {{(pid=61278) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_api:SELECT=4 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG dbcounter [-] [61278] Writing DB stats nova_cell1:SELECT=8 {{(pid=61278) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Acquiring lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG oslo_concurrency.lockutils [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Lock "db6d068e-9cbf-4ca5-a5c2-9826745af97f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61278) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 20 13:46:53 user devstack@n-api.service[61278]: INFO nova.api.openstack.wsgi [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] HTTP exception thrown: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Request method failure captured: Apr 20 13:46:53 user devstack@n-api.service[61278]: request: GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 HTTP/1.1 Apr 20 13:46:53 user devstack@n-api.service[61278]: Accept: application/json Apr 20 13:46:53 user devstack@n-api.service[61278]: Accept-Encoding: identity Apr 20 13:46:53 user devstack@n-api.service[61278]: Connection: close Apr 20 13:46:53 user devstack@n-api.service[61278]: Content-Length: 0 Apr 20 13:46:53 user devstack@n-api.service[61278]: Content-Type: application/json Apr 20 13:46:53 user devstack@n-api.service[61278]: Host: 10.0.0.210 Apr 20 13:46:53 user devstack@n-api.service[61278]: Openstack-System-Scope: None Apr 20 13:46:53 user devstack@n-api.service[61278]: User-Agent: python-urllib3/1.26.15 Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Auth-Token: gAAAAABkQUAUCfZJj_tZjJ1wtOXUypr8Hb-zS0u5TuaTMnLx0bhGeEY51nt7UMrIQG4NMBaSkxYVEl8YOFLedvFn_meBV4RPxXYTvXTsvBgqQCwMG0koUO5QId3UaA8QO3auqWO_9bFaAi9jkpw98i3UEBlckxd5JMrpkBFyJITgge8Hss15d-U Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Domain-Id: None Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Domain-Name: None Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Identity-Status: Confirmed Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Is-Admin-Project: True Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Project-Domain-Id: default Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Project-Domain-Name: Default Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Project-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Project-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Role: member,reader Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Roles: member,reader Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/5b14d9323d644570a9d07c6e22fe74ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}] Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Tenant: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Tenant-Id: 5b14d9323d644570a9d07c6e22fe74ed Apr 20 13:46:53 user devstack@n-api.service[61278]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1923426831 Apr 20 13:46:53 user devstack@n-api.service[61278]: X-User: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:53 user devstack@n-api.service[61278]: X-User-Domain-Id: default Apr 20 13:46:53 user devstack@n-api.service[61278]: X-User-Domain-Name: Default Apr 20 13:46:53 user devstack@n-api.service[61278]: X-User-Id: 4a2072628bc5432fbe2563643e1cea0e Apr 20 13:46:53 user devstack@n-api.service[61278]: X-User-Name: tempest-ServersNegativeTestJSON-1923426831-project-member Apr 20 13:46:53 user devstack@n-api.service[61278]: method: > Apr 20 13:46:53 user devstack@n-api.service[61278]: exception: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. Apr 20 13:46:53 user devstack@n-api.service[61278]: action_args: {'id': '0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4'} Apr 20 13:46:53 user devstack@n-api.service[61278]: {{(pid=61278) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. Apr 20 13:46:53 user devstack@n-api.service[61278]: ERROR nova.api.openstack.wsgi Apr 20 13:46:53 user devstack@n-api.service[61278]: DEBUG nova.api.openstack.wsgi [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] Returning 404 to user: Instance 0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 could not be found. {{(pid=61278) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 20 13:46:53 user devstack@n-api.service[61278]: INFO nova.api.openstack.requestlog [None req-03cea441-845f-48d3-b132-a9f001e0aa78 tempest-ServersNegativeTestJSON-1923426831 tempest-ServersNegativeTestJSON-1923426831-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4" status: 404 len: 111 microversion: 2.1 time: 0.039266 Apr 20 13:46:53 user devstack@n-api.service[61278]: [pid: 61278|app: 0|req: 154/461] 10.0.0.210 () {62 vars in 1313 bytes} [Thu Apr 20 13:46:53 2023] GET /compute/v2.1/servers/0bdc9a47-f644-4191-8fac-7fe4d9c9b6a4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)