Apr 18 20:51:13 user devstack@n-api.service[61132]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 18 20:51:13 user devstack@n-api.service[61132]: *** Starting uWSGI 2.0.20-debian (64bit) on [Tue Apr 18 20:51:13 2023] *** Apr 18 20:51:13 user devstack@n-api.service[61132]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 18 20:51:13 user devstack@n-api.service[61132]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 18 20:51:13 user devstack@n-api.service[61132]: nodename: user Apr 18 20:51:13 user devstack@n-api.service[61132]: machine: x86_64 Apr 18 20:51:13 user devstack@n-api.service[61132]: clock source: unix Apr 18 20:51:13 user devstack@n-api.service[61132]: pcre jit disabled Apr 18 20:51:13 user devstack@n-api.service[61132]: detected number of CPU cores: 12 Apr 18 20:51:13 user devstack@n-api.service[61132]: current working directory: / Apr 18 20:51:13 user devstack@n-api.service[61132]: detected binary path: /usr/bin/uwsgi-core Apr 18 20:51:13 user devstack@n-api.service[61132]: your processes number limit is 63637 Apr 18 20:51:13 user devstack@n-api.service[61132]: your memory page size is 4096 bytes Apr 18 20:51:13 user devstack@n-api.service[61132]: detected max file descriptor number: 2048 Apr 18 20:51:13 user devstack@n-api.service[61132]: lock engine: pthread robust mutexes Apr 18 20:51:13 user devstack@n-api.service[61132]: thunder lock: enabled Apr 18 20:51:13 user devstack@n-api.service[61132]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 18 20:51:13 user devstack@n-api.service[61132]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 18 20:51:13 user devstack@n-api.service[61132]: Python main interpreter initialized at 0x5619c6117990 Apr 18 20:51:13 user devstack@n-api.service[61132]: python threads support enabled Apr 18 20:51:13 user devstack@n-api.service[61132]: your server socket listen backlog is limited to 100 connections Apr 18 20:51:13 user devstack@n-api.service[61132]: your mercy for graceful operations on workers is 90 seconds Apr 18 20:51:13 user devstack@n-api.service[61132]: mapped 537436 bytes (524 KB) for 3 cores Apr 18 20:51:13 user devstack@n-api.service[61132]: *** Operational MODE: preforking *** Apr 18 20:51:13 user devstack@n-api.service[61132]: *** uWSGI is running in multiple interpreter mode *** Apr 18 20:51:13 user devstack@n-api.service[61132]: spawned uWSGI master process (pid: 61132) Apr 18 20:51:13 user devstack@n-api.service[61132]: spawned uWSGI worker 1 (pid: 61133, cores: 1) Apr 18 20:51:13 user devstack@n-api.service[61132]: spawned uWSGI worker 2 (pid: 61134, cores: 1) Apr 18 20:51:13 user devstack@n-api.service[61132]: spawned uWSGI worker 3 (pid: 61135, cores: 1) Apr 18 20:51:13 user devstack@n-api.service[61132]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 18 20:51:13 user devstack@n-api.service[61135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:51:13 user devstack@n-api.service[61134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:51:13 user devstack@n-api.service[61133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:51:17 user devstack@n-api.service[61135]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:51:17 user devstack@n-api.service[61135]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:51:17 user devstack@n-api.service[61135]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:51:17 user devstack@n-api.service[61135]: ). Its value may be silently ignored in the future. Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:51:17 user devstack@n-api.service[61133]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:51:17 user devstack@n-api.service[61133]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:51:17 user devstack@n-api.service[61133]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:51:17 user devstack@n-api.service[61133]: ). Its value may be silently ignored in the future. Apr 18 20:51:17 user devstack@n-api.service[61134]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 18 20:51:17 user devstack@n-api.service[61134]: live_migration_uri is deprecated for removal in favor of two other options that Apr 18 20:51:17 user devstack@n-api.service[61134]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 18 20:51:17 user devstack@n-api.service[61134]: and ``live_migration_inbound_addr`` respectively. Apr 18 20:51:17 user devstack@n-api.service[61134]: ). Its value may be silently ignored in the future. Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61135) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61133) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61134) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 18 20:51:17 user devstack@n-api.service[61135]: INFO dbcounter [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Registered counter for database nova_api Apr 18 20:51:17 user devstack@n-api.service[61133]: INFO dbcounter [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Registered counter for database nova_api Apr 18 20:51:17 user devstack@n-api.service[61134]: INFO dbcounter [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Registered counter for database nova_api Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_db.sqlalchemy.engines [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61135) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61133) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_db.sqlalchemy.engines [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61134) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writer thread running {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writer thread running {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writer thread running {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG nova.context [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88560d0d-7818-4020-888f-ef6d4621691d(cell1) {{(pid=61133) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG nova.context [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88560d0d-7818-4020-888f-ef6d4621691d(cell1) {{(pid=61135) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG nova.context [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),88560d0d-7818-4020-888f-ef6d4621691d(cell1) {{(pid=61134) load_cells /opt/stack/nova/nova/context.py:464}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61133]: INFO dbcounter [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61133]: INFO dbcounter [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Registered counter for database nova_cell1 Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:51:17 user devstack@n-api.service[61135]: INFO dbcounter [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61134]: INFO dbcounter [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61135]: INFO dbcounter [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Registered counter for database nova_cell1 Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61133) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61133) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: INFO dbcounter [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Registered counter for database nova_cell1 Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writer thread running {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_db.sqlalchemy.engines [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61135) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writer thread running {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writer thread running {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_db.sqlalchemy.engines [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61135) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_db.sqlalchemy.engines [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61134) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writer thread running {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_db.sqlalchemy.engines [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61134) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61133]: INFO dbcounter [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writer thread running {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG oslo_db.sqlalchemy.engines [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61133) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61135]: INFO dbcounter [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writer thread running {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writer thread running {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG oslo_db.sqlalchemy.engines [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61135) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: INFO dbcounter [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Registered counter for database nova_cell0 Apr 18 20:51:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writer thread running {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG oslo_db.sqlalchemy.engines [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61134) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 18 20:51:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writer thread running {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 18 20:51:18 user devstack@n-api.service[61133]: WARNING keystonemiddleware.auth_token [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61135]: WARNING keystonemiddleware.auth_token [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61133]: WARNING keystonemiddleware.auth_token [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61135]: WARNING keystonemiddleware.auth_token [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61134]: WARNING keystonemiddleware.auth_token [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61134]: WARNING keystonemiddleware.auth_token [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61133]: WARNING keystonemiddleware.auth_token [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61133]: WARNING keystonemiddleware.auth_token [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61133]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619c6117990 pid: 61133 (default app) Apr 18 20:51:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:51:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001447 Apr 18 20:51:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Tue Apr 18 20:51:18 2023] GET /compute/v2.1/ => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:51:18 user devstack@n-api.service[61135]: WARNING keystonemiddleware.auth_token [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61135]: WARNING keystonemiddleware.auth_token [None req-243b2e8a-3dc4-4f1f-9396-18dc7d5cbf69 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61135]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619c6117990 pid: 61135 (default app) Apr 18 20:51:18 user devstack@n-api.service[61134]: WARNING keystonemiddleware.auth_token [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 18 20:51:18 user devstack@n-api.service[61134]: WARNING keystonemiddleware.auth_token [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 18 20:51:18 user devstack@n-api.service[61134]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5619c6117990 pid: 61134 (default app) Apr 18 20:53:25 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-1a4001cf-4238-43b6-89f8-979f9d561cb7 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001433 Apr 18 20:53:25 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:25 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e0afbf39-4dcb-46ff-93fe-5d53d6afb38a admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:25 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e0afbf39-4dcb-46ff-93fe-5d53d6afb38a admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.398584 Apr 18 20:53:25 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 20:53:25 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:27 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:27 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002120 Apr 18 20:53:27 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:27 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:27 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:27 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:27 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:27 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:28 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-d5dcdeb8-c82d-4043-aa24-17ae73275cad admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "c1", "ram": 256, "disk": 1}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-d5dcdeb8-c82d-4043-aa24-17ae73275cad admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.310591 Apr 18 20:53:28 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:27 2023] POST /compute/v2.1/flavors => generated 405 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:28 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-eb27edf8-ede5-445a-a417-efc6e5702ebc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:28 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-eb27edf8-ede5-445a-a417-efc6e5702ebc admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047548 Apr 18 20:53:28 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:53:28 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:30 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:30 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001601 Apr 18 20:53:30 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:30 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:30 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-49827082-b928-4d1b-8c69-cfe751590d4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 5, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:30 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-49827082-b928-4d1b-8c69-cfe751590d4c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.065151 Apr 18 20:53:30 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:30 2023] POST /compute/v2.1/flavors => generated 402 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:30 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-9c3faf6c-0e9c-4607-89b4-cf3307dd22bd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:30 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-9c3faf6c-0e9c-4607-89b4-cf3307dd22bd admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025914 Apr 18 20:53:30 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:53:30 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:32 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:32 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001605 Apr 18 20:53:32 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:32 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:32 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-3aa07000-32b0-4dc0-9831-a76dacd677c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "vcpus": 1, "ram": 1024}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:32 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-3aa07000-32b0-4dc0-9831-a76dacd677c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067014 Apr 18 20:53:32 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:32 2023] POST /compute/v2.1/flavors => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:32 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-7378c9fb-96ba-407c-9d85-5493309443af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:32 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-7378c9fb-96ba-407c-9d85-5493309443af admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023620 Apr 18 20:53:32 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:53:32 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:34 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001767 Apr 18 20:53:34 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:34 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:34 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-db39630f-fcce-49b6-b607-9425131dbd09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 10, "name": "ds2G", "ram": 2048, "swap": 0, "rxtx_factor": 1.0}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:34 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-db39630f-fcce-49b6-b607-9425131dbd09 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.070200 Apr 18 20:53:34 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:34 2023] POST /compute/v2.1/flavors => generated 402 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:34 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-936c1229-b208-4af8-8a86-f1683965080e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:34 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-936c1229-b208-4af8-8a86-f1683965080e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025314 Apr 18 20:53:34 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:53:34 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:36 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001597 Apr 18 20:53:36 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:36 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:36 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-a4151456-080e-4eb6-ab5a-e62e32794099 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:36 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-a4151456-080e-4eb6-ab5a-e62e32794099 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.108101 Apr 18 20:53:36 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:36 2023] POST /compute/v2.1/flavors => generated 402 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:36 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:36 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023094 Apr 18 20:53:36 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Tue Apr 18 20:53:36 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:38 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:38 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-abae3048-eaae-45f6-943c-cbb83a63547e None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.013458 Apr 18 20:53:38 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:38 2023] GET /compute/v2.1 => generated 387 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:38 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-77b239ec-5220-45de-8246-a66daacf230e admin admin] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-77b239ec-5220-45de-8246-a66daacf230e admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.070349 Apr 18 20:53:38 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Tue Apr 18 20:53:38 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:53:40 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:40 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001493 Apr 18 20:53:40 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:53:40 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-e13f5780-0290-4d2c-aa18-1f5b9bb9e59c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 512}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:40 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-e13f5780-0290-4d2c-aa18-1f5b9bb9e59c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.461824 Apr 18 20:53:40 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:40 2023] POST /compute/v2.1/flavors => generated 400 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:40 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-09c1564f-3b84-4767-9819-7128d1a6aa79 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:40 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-09c1564f-3b84-4767-9819-7128d1a6aa79 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040709 Apr 18 20:53:40 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:53:40 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:42 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:42 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001364 Apr 18 20:53:42 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:42 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5befb9bd-4a67-42fa-8e14-e4d11020a08e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:42 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-5befb9bd-4a67-42fa-8e14-e4d11020a08e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.062134 Apr 18 20:53:42 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:42 2023] POST /compute/v2.1/flavors => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:42 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fdfbb8a0-83ab-45ad-9f3f-ea558ba640e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:42 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-fdfbb8a0-83ab-45ad-9f3f-ea558ba640e4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027225 Apr 18 20:53:42 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:53:42 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:44 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:44 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001312 Apr 18 20:53:44 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:44 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-dc451431-bb65-4fde-a50a-70c9069d01b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "id": "3", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:44 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-dc451431-bb65-4fde-a50a-70c9069d01b5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.060777 Apr 18 20:53:44 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:44 2023] POST /compute/v2.1/flavors => generated 404 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-de69d5dc-df14-42c5-8c01-a45627e034ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:44 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-de69d5dc-df14-42c5-8c01-a45627e034ee admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040633 Apr 18 20:53:44 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:53:44 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:46 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:46 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002049 Apr 18 20:53:46 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:46 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:46 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6320d49f-5252-4c92-81f5-796df75ab37a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "swap": 0, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large"}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:46 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6320d49f-5252-4c92-81f5-796df75ab37a admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.059829 Apr 18 20:53:46 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:46 2023] POST /compute/v2.1/flavors => generated 403 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:46 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-7afb5405-7e91-4efd-91db-2d8bce83aa12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:46 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-7afb5405-7e91-4efd-91db-2d8bce83aa12 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.024342 Apr 18 20:53:46 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:53:46 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:53:48 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:53:48 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001484 Apr 18 20:53:48 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Tue Apr 18 20:53:48 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:53:48 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-437c52a2-e304-48e7-a07e-1100305981b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:48 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-437c52a2-e304-48e7-a07e-1100305981b4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060807 Apr 18 20:53:48 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Tue Apr 18 20:53:48 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:53:48 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fbab13da-d0d9-40d6-bd0a-da909af531e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:53:48 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-fbab13da-d0d9-40d6-bd0a-da909af531e2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027683 Apr 18 20:53:48 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Tue Apr 18 20:53:48 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:54:19 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:19 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5739ed40-74af-4c9a-89ba-f45f69b7c176 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002235 Apr 18 20:54:19 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:54:19 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:54:19 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:54:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:54:20 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.141916 Apr 18 20:54:20 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Tue Apr 18 20:54:19 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:54:51 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fbab13da-d0d9-40d6-bd0a-da909af531e2 admin admin] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:51 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-fbab13da-d0d9-40d6-bd0a-da909af531e2 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002632 Apr 18 20:54:51 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:54:51 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:54:51 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:54:51 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d3af0726-7bf4-42cb-b635-4f5a4912847d admin admin] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d3af0726-7bf4-42cb-b635-4f5a4912847d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.065087 Apr 18 20:54:51 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Tue Apr 18 20:54:51 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:54:55 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:55 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001686 Apr 18 20:54:55 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:54:55 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:54:55 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:54:55 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-52ace3d2-0dc8-4f29-956b-35a20e4d0b56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "42", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 128, "swap": 0, "name": "m1.nano", "disk": 1}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:54:55 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-52ace3d2-0dc8-4f29-956b-35a20e4d0b56 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.067756 Apr 18 20:54:55 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 20:54:55 2023] POST /compute/v2.1/flavors => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:54:55 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-484c9a54-259a-434c-ac89-fcf39080b932 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:54:55 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-484c9a54-259a-434c-ac89-fcf39080b932 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050189 Apr 18 20:54:55 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 20:54:55 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:54:59 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:54:59 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ebc685f0-09c6-419d-ad31-920b3d9e94e9 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001630 Apr 18 20:54:59 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Tue Apr 18 20:54:59 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:54:59 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-dce1b3da-47f0-443d-9848-2c03adbd766c admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "84", "swap": 0, "name": "m1.micro", "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:54:59 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-dce1b3da-47f0-443d-9848-2c03adbd766c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.062829 Apr 18 20:54:59 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Tue Apr 18 20:54:59 2023] POST /compute/v2.1/flavors => generated 404 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:54:59 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f3a92628-81ca-4255-ad5b-3c8f4cc8f777 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:54:59 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-f3a92628-81ca-4255-ad5b-3c8f4cc8f777 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029612 Apr 18 20:54:59 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Tue Apr 18 20:54:59 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:57:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:12 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-329450b8-6bba-4742-adaf-14c6209b1ed8 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Action: 'create', calling method: .version_select at 0x7f51d4d9b250>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1941683296"}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:13 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-329450b8-6bba-4742-adaf-14c6209b1ed8 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.801662 Apr 18 20:57:13 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 15/46] 10.0.0.210 () {64 vars in 1232 bytes} [Tue Apr 18 20:57:11 2023] POST /compute/v2.1/os-volumes => generated 345 bytes in 1803 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 20:57:13 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:13 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-633e1aa6-6f99-4624-af09-ec02b31adc75 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Calling method '.version_select at 0x7f51d4d8ff40>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-633e1aa6-6f99-4624-af09-ec02b31adc75 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280" status: 200 len: 342 microversion: 2.1 time: 0.192246 Apr 18 20:57:13 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:57:13 2023] GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280 => generated 342 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:14 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:14 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-fdd9d167-ae2e-407e-bb36-bf5d12c74187 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Calling method '.version_select at 0x7f51d4d025f0>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:15 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-fdd9d167-ae2e-407e-bb36-bf5d12c74187 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280" status: 200 len: 342 microversion: 2.1 time: 0.586564 Apr 18 20:57:15 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:57:14 2023] GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280 => generated 342 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:15 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-543c2561-5b71-4e5c-9728-639dde389255 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Calling method '.version_select at 0x7f51d4c24940>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:15 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-543c2561-5b71-4e5c-9728-639dde389255 tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280" status: 202 len: 0 microversion: 2.1 time: 0.162746 Apr 18 20:57:15 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:57:15 2023] DELETE /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:57:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-027da177-c6d4-4b5f-9f38-c41f5dbb4fda tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Calling method '.version_select at 0x7f51d4c239a0>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-027da177-c6d4-4b5f-9f38-c41f5dbb4fda tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] HTTP exception thrown: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. Apr 18 20:57:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-027da177-c6d4-4b5f-9f38-c41f5dbb4fda tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Request method failure captured: Apr 18 20:57:15 user devstack@n-api.service[61133]: request: GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280 HTTP/1.1 Apr 18 20:57:15 user devstack@n-api.service[61133]: Accept: application/json Apr 18 20:57:15 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 20:57:15 user devstack@n-api.service[61133]: Connection: close Apr 18 20:57:15 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 20:57:15 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 20:57:15 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 20:57:15 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 20:57:15 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQnqB33sISb3s890f7DnDlPz6k9vEh8qLh62v0w6lTT1XW8ug3WmpScbgDSF9abdeZKVZY_-bubxqSAhFc6qtYpfL_ssB90v_Ng-BRAEjSlTKlg6Lyrkv1Z2nUyFmguNaeE4xgxxr0gC7-mq478TnpcxQ57-aldcOwXMoDarHAnJO8 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Project-Id: 90564e9bfe17438d81616c815b9fd628 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-605985202 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90564e9bfe17438d81616c815b9fd628"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/90564e9bfe17438d81616c815b9fd628"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/90564e9bfe17438d81616c815b9fd628"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-605985202 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Tenant-Id: 90564e9bfe17438d81616c815b9fd628 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-605985202 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-User: tempest-VolumesSnapshotsTestJSON-605985202-project-member Apr 18 20:57:15 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 20:57:15 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 20:57:15 user devstack@n-api.service[61133]: X-User-Id: ffe5ce7eaa3e41ea9f39d5a956181699 Apr 18 20:57:15 user devstack@n-api.service[61133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-605985202-project-member Apr 18 20:57:15 user devstack@n-api.service[61133]: method: Apr 18 20:57:15 user devstack@n-api.service[61133]: exception: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. Apr 18 20:57:15 user devstack@n-api.service[61133]: action_args: {'id': '71126e0d-6dda-48f2-b1ae-258241264280'} Apr 18 20:57:15 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. (HTTP 404) (Request-ID: req-aea222a7-f575-4e58-976f-920bd397e27b) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. Apr 18 20:57:15 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-027da177-c6d4-4b5f-9f38-c41f5dbb4fda tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] Returning 404 to user: Volume 71126e0d-6dda-48f2-b1ae-258241264280 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-027da177-c6d4-4b5f-9f38-c41f5dbb4fda tempest-VolumesSnapshotsTestJSON-605985202 tempest-VolumesSnapshotsTestJSON-605985202-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280" status: 404 len: 109 microversion: 2.1 time: 0.035217 Apr 18 20:57:15 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:57:15 2023] GET /compute/v2.1/os-volumes/71126e0d-6dda-48f2-b1ae-258241264280 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:57:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-079d2f0c-b064-496b-a4b9-c94ac17e42b6 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Action: 'create', calling method: .version_select at 0x7f51d4c27130>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-272088669", "metadata": {"Type": "work"}}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-079d2f0c-b064-496b-a4b9-c94ac17e42b6 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:17 user devstack@n-api.service[61135]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:57:17 user devstack@n-api.service[61135]: Accept: application/json Apr 18 20:57:17 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 20:57:17 user devstack@n-api.service[61135]: Connection: close Apr 18 20:57:17 user devstack@n-api.service[61135]: Content-Length: 121 Apr 18 20:57:17 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 20:57:17 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 20:57:17 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 20:57:17 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:17 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:17 user devstack@n-api.service[61135]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:17 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 20:57:17 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 20:57:17 user devstack@n-api.service[61135]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:17 user devstack@n-api.service[61135]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:17 user devstack@n-api.service[61135]: Apr 18 20:57:17 user devstack@n-api.service[61135]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-272088669", "metadata": {"Type": "work"}}} Apr 18 20:57:17 user devstack@n-api.service[61135]: method: Apr 18 20:57:17 user devstack@n-api.service[61135]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:57:17 user devstack@n-api.service[61135]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-272088669', 'metadata': {'Type': 'work'}}}} Apr 18 20:57:17 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi '#$%' Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 18 20:57:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-079d2f0c-b064-496b-a4b9-c94ac17e42b6 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:17 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-079d2f0c-b064-496b-a4b9-c94ac17e42b6 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.162562 Apr 18 20:57:17 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 17/51] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:57:17 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:57:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-80c404bb-49df-48d9-af26-4fbb2a3d54ce tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Action: 'create', calling method: .version_select at 0x7f51d4c24f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2132646796", "metadata": {"Type": "work"}}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-80c404bb-49df-48d9-af26-4fbb2a3d54ce tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:18 user devstack@n-api.service[61134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:57:18 user devstack@n-api.service[61134]: Accept: application/json Apr 18 20:57:18 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 20:57:18 user devstack@n-api.service[61134]: Connection: close Apr 18 20:57:18 user devstack@n-api.service[61134]: Content-Length: 120 Apr 18 20:57:18 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 20:57:18 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 20:57:18 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 20:57:18 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61134]: Apr 18 20:57:18 user devstack@n-api.service[61134]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2132646796", "metadata": {"Type": "work"}}} Apr 18 20:57:18 user devstack@n-api.service[61134]: method: Apr 18 20:57:18 user devstack@n-api.service[61134]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:57:18 user devstack@n-api.service[61134]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2132646796', 'metadata': {'Type': 'work'}}}} Apr 18 20:57:18 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi '0' Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-80c404bb-49df-48d9-af26-4fbb2a3d54ce tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-80c404bb-49df-48d9-af26-4fbb2a3d54ce tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018761 Apr 18 20:57:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 17/52] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:57:17 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1532649b-e8bd-4d7e-b173-82da92bfce48 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Action: 'create', calling method: .version_select at 0x7f51d4c6d090>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-522055664", "metadata": {"Type": "work"}}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1532649b-e8bd-4d7e-b173-82da92bfce48 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:18 user devstack@n-api.service[61133]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 18 20:57:18 user devstack@n-api.service[61133]: Accept: application/json Apr 18 20:57:18 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 20:57:18 user devstack@n-api.service[61133]: Connection: close Apr 18 20:57:18 user devstack@n-api.service[61133]: Content-Length: 118 Apr 18 20:57:18 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 20:57:18 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 20:57:18 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 20:57:18 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61133]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61133]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:18 user devstack@n-api.service[61133]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61133]: Apr 18 20:57:18 user devstack@n-api.service[61133]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-522055664", "metadata": {"Type": "work"}}} Apr 18 20:57:18 user devstack@n-api.service[61133]: method: Apr 18 20:57:18 user devstack@n-api.service[61133]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:57:18 user devstack@n-api.service[61133]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-522055664', 'metadata': {'Type': 'work'}}}} Apr 18 20:57:18 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise error Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi '' Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 18 20:57:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1532649b-e8bd-4d7e-b173-82da92bfce48 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-1532649b-e8bd-4d7e-b173-82da92bfce48 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010699 Apr 18 20:57:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 19/53] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:57:18 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-bec2a0f7-af3b-4a66-88a2-bf5ff525419f tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Calling method '.version_select at 0x7f51d4c27a30>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-bec2a0f7-af3b-4a66-88a2-bf5ff525419f tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] HTTP exception thrown: Volume tempest-invalid-885636980 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-bec2a0f7-af3b-4a66-88a2-bf5ff525419f tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:18 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-885636980 HTTP/1.1 Apr 18 20:57:18 user devstack@n-api.service[61135]: Accept: application/json Apr 18 20:57:18 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 20:57:18 user devstack@n-api.service[61135]: Connection: close Apr 18 20:57:18 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 20:57:18 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 20:57:18 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 20:57:18 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 20:57:18 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61135]: method: Apr 18 20:57:18 user devstack@n-api.service[61135]: exception: Volume tempest-invalid-885636980 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: action_args: {'id': 'tempest-invalid-885636980'} Apr 18 20:57:18 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-885636980 could not be found. (HTTP 404) (Request-ID: req-3998ce91-38c7-405e-9a90-a2dc2383cdae) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-885636980 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-885636980 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-885636980 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-bec2a0f7-af3b-4a66-88a2-bf5ff525419f tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 404 to user: Volume tempest-invalid-885636980 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-bec2a0f7-af3b-4a66-88a2-bf5ff525419f tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-885636980" status: 404 len: 98 microversion: 2.1 time: 0.040335 Apr 18 20:57:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1292 bytes} [Tue Apr 18 20:57:18 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-885636980 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-58b19b3e-c850-4ff8-b63f-4ff2943350a7 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005097 Apr 18 20:57:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1217 bytes} [Tue Apr 18 20:57:18 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-95d07f97-30be-4347-8305-99da044de93b tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004441 Apr 18 20:57:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1214 bytes} [Tue Apr 18 20:57:18 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c6395c2e-746d-4fc8-9684-f704c1007ac0 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Calling method '.version_select at 0x7f51d4c35510>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-c6395c2e-746d-4fc8-9684-f704c1007ac0 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] HTTP exception thrown: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c6395c2e-746d-4fc8-9684-f704c1007ac0 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:18 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/os-volumes/5e7f2116-151e-40c4-9269-601d1b5dd76a HTTP/1.1 Apr 18 20:57:18 user devstack@n-api.service[61135]: Accept: application/json Apr 18 20:57:18 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 20:57:18 user devstack@n-api.service[61135]: Connection: close Apr 18 20:57:18 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 20:57:18 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 20:57:18 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 20:57:18 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 20:57:18 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:18 user devstack@n-api.service[61135]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61135]: method: Apr 18 20:57:18 user devstack@n-api.service[61135]: exception: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: action_args: {'id': '5e7f2116-151e-40c4-9269-601d1b5dd76a'} Apr 18 20:57:18 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. (HTTP 404) (Request-ID: req-f8bee374-024d-4f01-a201-26ed96c2a61b) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. Apr 18 20:57:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c6395c2e-746d-4fc8-9684-f704c1007ac0 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 404 to user: Volume 5e7f2116-151e-40c4-9269-601d1b5dd76a could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c6395c2e-746d-4fc8-9684-f704c1007ac0 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5e7f2116-151e-40c4-9269-601d1b5dd76a" status: 404 len: 109 microversion: 2.1 time: 0.050401 Apr 18 20:57:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 19/57] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:57:18 2023] DELETE /compute/v2.1/os-volumes/5e7f2116-151e-40c4-9269-601d1b5dd76a => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:57:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-d2139a14-67c6-464a-8799-9a32cfccaeb4 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Calling method '.version_select at 0x7f51d4c25870>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-d2139a14-67c6-464a-8799-9a32cfccaeb4 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] HTTP exception thrown: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-d2139a14-67c6-464a-8799-9a32cfccaeb4 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Request method failure captured: Apr 18 20:57:18 user devstack@n-api.service[61134]: request: GET /compute/v2.1/os-volumes/456e1dde-e166-46ba-bb27-3f162dd30886 HTTP/1.1 Apr 18 20:57:18 user devstack@n-api.service[61134]: Accept: application/json Apr 18 20:57:18 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 20:57:18 user devstack@n-api.service[61134]: Connection: close Apr 18 20:57:18 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 20:57:18 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 20:57:18 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 20:57:18 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 20:57:18 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQtSEwlFCyIAXBjJywd8ON0pEspmHukaURGSYscXAvdZjFzWUOAJ0BaXE5dqcjZqlIRmmqYXFXk1lrrgVPq9UNEcRRgZWhSgCxqejIaYhClE2IK8yNvnJAZTH1HDhsUnD4I_liXg_wpqMZ9IRgrQHVGabrjFp1AjTwhZfRN_PwGxng Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Project-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8420ea3d726148ec9ae78394b0b7b2fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant-Id: 8420ea3d726148ec9ae78394b0b7b2fc Apr 18 20:57:18 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-VolumesNegativeTest-1020156560 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Id: fd9d01eba90e4d1aa67f60f0422cf666 Apr 18 20:57:18 user devstack@n-api.service[61134]: X-User-Name: tempest-VolumesNegativeTest-1020156560-project-member Apr 18 20:57:18 user devstack@n-api.service[61134]: method: Apr 18 20:57:18 user devstack@n-api.service[61134]: exception: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61134]: action_args: {'id': '456e1dde-e166-46ba-bb27-3f162dd30886'} Apr 18 20:57:18 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. (HTTP 404) (Request-ID: req-aaaa7d39-4433-4f1b-b403-3c5c86e7225b) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. Apr 18 20:57:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 20:57:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-d2139a14-67c6-464a-8799-9a32cfccaeb4 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] Returning 404 to user: Volume 456e1dde-e166-46ba-bb27-3f162dd30886 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:57:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-d2139a14-67c6-464a-8799-9a32cfccaeb4 tempest-VolumesNegativeTest-1020156560 tempest-VolumesNegativeTest-1020156560-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/456e1dde-e166-46ba-bb27-3f162dd30886" status: 404 len: 109 microversion: 2.1 time: 0.038482 Apr 18 20:57:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 19/58] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:57:18 2023] GET /compute/v2.1/os-volumes/456e1dde-e166-46ba-bb27-3f162dd30886 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:57:26 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-556738693", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "2a459fb0-36eb-4c75-afd7-0de7482741f7"}]}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:26 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] validate_networks() for [('2a459fb0-36eb-4c75-afd7-0de7482741f7', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:28 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-621498657", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "72db7f05-bed4-4551-8c9a-429bcc60d565"}]}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:29 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] validate_networks() for [('72db7f05-bed4-4551-8c9a-429bcc60d565', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for user e6caad8bd6fe44b6ab8868167473d4fe and project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:29 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:29 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-5efe7a10-fbad-49d1-a3a6-4ac074289b17 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 3.053506 Apr 18 20:57:29 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 21/59] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:57:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 3055 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Apr 18 20:57:29 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:29 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:29 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:29 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:29 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:29 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-b45a6208-f8bc-4553-acdf-5b8bace5f4a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 200 len: 1394 microversion: 2.87 time: 0.223559 Apr 18 20:57:29 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:57:29 2023] GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 1394 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Getting quotas for project 9e8f3ac2c484400fbfcbf466d3a57f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Getting quotas for user 771843bc852b4922a50056eab2be979d and project 9e8f3ac2c484400fbfcbf466d3a57f2f. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:31 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:31 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-dada71f4-53e1-4f4e-970b-2aefd74940e9 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 2.726699 Apr 18 20:57:31 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 20/61] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:57:28 2023] POST /compute/v2.1/servers => generated 378 bytes in 2728 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:57:31 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-670e7b2e-805b-4d98-abcd-cbccda57cc6b tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:31 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-670e7b2e-805b-4d98-abcd-cbccda57cc6b tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:31 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-670e7b2e-805b-4d98-abcd-cbccda57cc6b tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771843bc852b4922a50056eab2be979d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8f3ac2c484400fbfcbf466d3a57f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-670e7b2e-805b-4d98-abcd-cbccda57cc6b tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251" status: 200 len: 1208 microversion: 2.1 time: 0.304106 Apr 18 20:57:31 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 22/62] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:57:31 2023] GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 => generated 1208 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:57:31 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-476528872", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:32 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] validate_networks() for [('802ad868-23b7-4bad-8705-d615b5fecb53', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:33 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-8cbcbd8d-6735-45c1-8e35-de9441c6dfcf tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Action: 'create', calling method: .version_select at 0x7f51d4b6a950>, body: {"keypair": {"name": "tempest-keypair-1929553880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECWOyaon8tCjBJi6I0uv0VRVvnJ1BnfpdAvUX/49cZZhRjyxt8fdpvmyFBvNjh0i442IU4Sk8D5laY/EUpD5cEz2t2CGbohM31z5KRE6OV7GOOhepT3KN3iaOzneMnpbw=="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:33 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-8cbcbd8d-6735-45c1-8e35-de9441c6dfcf tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:33 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-8cbcbd8d-6735-45c1-8e35-de9441c6dfcf tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for user 220589b8afc240778bff63d1e5ce20d1 and project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-8cbcbd8d-6735-45c1-8e35-de9441c6dfcf tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.339591 Apr 18 20:57:33 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 21/63] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 20:57:33 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 341 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Getting quotas for project ef80599ace4b477c9a9222526789e3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Getting quotas for user 790ad228383143da97ce2b964b7fce07 and project ef80599ace4b477c9a9222526789e3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-a51fd763-1047-4dfc-87ca-a5a13e672be8 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.489398 Apr 18 20:57:34 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 21/64] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:57:31 2023] POST /compute/v2.1/servers => generated 381 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:57:34 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c48746d6-d22d-48b0-89ec-0f3131d8966f tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:34 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c48746d6-d22d-48b0-89ec-0f3131d8966f tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:34 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c48746d6-d22d-48b0-89ec-0f3131d8966f tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:34 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c48746d6-d22d-48b0-89ec-0f3131d8966f tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b" status: 200 len: 1215 microversion: 2.1 time: 0.157610 Apr 18 20:57:34 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 22/65] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:57:34 2023] GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b => generated 1215 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:57:34 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-aea87801-6d58-4140-92f2-25bee4f3b285 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Action: 'create', calling method: .version_select at 0x7f51d4ba43a0>, body: {"keypair": {"name": "tempest-keypair-280229981", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFZ3mtD6dbg/sH/bfLL45e8YWnNuQvbN4NoTdQywz7ogxfM4Gw75mfhS0fSlJhcbyzYofAQSS+ebeMsW06mQzItR/rbssZ6+k+qN8vQnF6+NnaYyO5lQifjubPvHni9fw=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:34 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-aea87801-6d58-4140-92f2-25bee4f3b285 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Getting quotas for project f7f30bf556984db19a19b918133d0ade. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:34 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-aea87801-6d58-4140-92f2-25bee4f3b285 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Getting quotas for user 9856fa4dcb9d407bbeb0952587500917 and project f7f30bf556984db19a19b918133d0ade. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:34 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-aea87801-6d58-4140-92f2-25bee4f3b285 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.365234 Apr 18 20:57:34 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 23/66] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:57:34 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1521910482", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:34 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] validate_networks() for [('802ad868-23b7-4bad-8705-d615b5fecb53', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:36 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Getting quotas for project ef80599ace4b477c9a9222526789e3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:36 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Getting quotas for user 790ad228383143da97ce2b964b7fce07 and project ef80599ace4b477c9a9222526789e3c6. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:36 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:36 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-9501d689-3050-460a-8b82-e0b48a2a91b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 1.404233 Apr 18 20:57:36 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 22/67] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:57:34 2023] POST /compute/v2.1/servers => generated 381 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:57:36 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-57b6fe2b-0d7f-4e12-89ed-56d2a98bc1a2 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:36 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-57b6fe2b-0d7f-4e12-89ed-56d2a98bc1a2 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:36 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-57b6fe2b-0d7f-4e12-89ed-56d2a98bc1a2 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:36 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-57b6fe2b-0d7f-4e12-89ed-56d2a98bc1a2 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 200 len: 1216 microversion: 2.1 time: 0.169308 Apr 18 20:57:36 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:57:36 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 1216 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:39 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Creating event network-changed:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61133) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3183ced0-373b-47a7-8ff3-1925ddc5d77b req-626d7aa7-f0ac-4e1e-9f00-22bb935f69f0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61133) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:39 user devstack@n-api.service[61133]: INFO nova.compute.rpcapi [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:57:39 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] Releasing lock "compute-rpcapi-router" {{(pid=61133) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:57:39 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-72ca2b2e-7346-46dc-9013-4c7fbd297e28 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271842 Apr 18 20:57:39 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 24/69] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:40 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Creating event network-changed:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61134) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f253d1-d16f-41f7-939c-5484f8d2ee5d req-c6f2b817-003c-4c63-93fb-1cedc9a4ca6d service nova] Acquired lock "compute-rpcapi-router" {{(pid=61134) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:40 user devstack@n-api.service[61134]: INFO nova.compute.rpcapi [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:57:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] Releasing lock "compute-rpcapi-router" {{(pid=61134) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:57:40 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ef242874-4c76-4101-8539-7ee7f94a6dde None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.275158 Apr 18 20:57:40 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 23/70] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:41 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Creating event network-changed:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61135) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-25bff3f8-817e-4435-a546-96fe3404c2a4 req-95d3a3e7-695a-437e-8f34-031ab568898e service nova] Acquired lock "compute-rpcapi-router" {{(pid=61135) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:41 user devstack@n-api.service[61135]: INFO nova.compute.rpcapi [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 18 20:57:41 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] Releasing lock "compute-rpcapi-router" {{(pid=61135) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 18 20:57:41 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-16acf22c-edd6-4a6e-8e1e-39ad4a0e3950 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165458 Apr 18 20:57:41 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 24/71] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:41 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-106760453", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a22cbca0-4451-45e1-8cdc-b8649f5dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--429277040"}], "key_name": "tempest-keypair-1929553880", "user_data": "}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:41 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] validate_networks() for [('a22cbca0-4451-45e1-8cdc-b8649f5dfe5d', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:42 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1267822158", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "e8ac6e16-c9e2-4d15-b1fb-e33f0eea2d59"}], "security_groups": [{"name": "tempest-securitygroup--396920405"}], "key_name": "tempest-keypair-280229981", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:43 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] validate_networks() for [('e8ac6e16-c9e2-4d15-b1fb-e33f0eea2d59', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:57:43 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] Creating event network-changed:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:57:43 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-7d6d6e88-49d7-4182-839d-6b54e151214b req-3e10cbd1-9c39-4585-82cf-ae5f9dd3a05e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033399 Apr 18 20:57:43 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 25/72] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:43 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for user 220589b8afc240778bff63d1e5ce20d1 and project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:43 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:43 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-c4f3ca0c-c0df-4932-a06d-210b3bd2dcb4 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 2.210356 Apr 18 20:57:43 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 25/73] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 20:57:41 2023] POST /compute/v2.1/servers => generated 399 bytes in 2212 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:43 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:44 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:44 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:44 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:44 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c24ca830-5ebd-4a16-9754-1b6ca566f6f2 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 200 len: 1275 microversion: 2.20 time: 0.122940 Apr 18 20:57:44 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 26/74] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:57:43 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 1275 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Getting quotas for project f7f30bf556984db19a19b918133d0ade. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Getting quotas for user 9856fa4dcb9d407bbeb0952587500917 and project f7f30bf556984db19a19b918133d0ade. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:57:44 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:57:44 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ba473e54-7ab0-4aa1-bf31-fc88d34ffa37 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.839552 Apr 18 20:57:44 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 24/75] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:57:42 2023] POST /compute/v2.1/servers => generated 403 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:57:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-32c94d99-fa6a-4b7d-94d0-218342159f30 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:57:44 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-32c94d99-fa6a-4b7d-94d0-218342159f30 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:57:44 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-32c94d99-fa6a-4b7d-94d0-218342159f30 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9856fa4dcb9d407bbeb0952587500917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f30bf556984db19a19b918133d0ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:57:44 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-32c94d99-fa6a-4b7d-94d0-218342159f30 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 200 len: 1239 microversion: 2.1 time: 0.108933 Apr 18 20:57:44 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 26/76] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:57:44 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 1239 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:57:47 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:47 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] Creating event network-vif-plugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 20:57:47 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-90c1bc27-d3e7-4039-bbe9-902ed5c853fa req-dc7fcdab-0fbc-4d3d-91a0-f3b7740b7ff1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038613 Apr 18 20:57:47 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 27/77] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:47 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:49 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}, {"server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "name": "network-vif-plugged", "status": "completed", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}, {"server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "name": "network-vif-plugged", "status": "completed", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Creating event network-vif-plugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 20:57:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Creating event network-vif-plugged:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:57:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] Creating event network-vif-plugged:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:57:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-dd06715d-578c-4d46-b3be-71b82b492110 req-139c7a1e-8223-4075-994d-c4fac4c63b2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.059847 Apr 18 20:57:49 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 25/78] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:49 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] Creating event network-changed:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:57:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-58a9457b-bf26-4580-839d-c4ed6302e860 req-ea25f3eb-1b79-4ee3-8a60-fa697c2f0e91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076084 Apr 18 20:57:50 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 27/79] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:50 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:51 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "name": "network-vif-plugged", "status": "completed", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}, {"server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "name": "network-vif-plugged", "status": "completed", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}, {"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:51 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=4 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Creating event network-vif-plugged:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 20:57:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Creating event network-vif-plugged:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 20:57:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:57:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-e9af3dde-4e11-43fc-8c4e-255a032758c6 req-75ecaba7-66ec-4755-a2a3-26da2cb32398 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053294 Apr 18 20:57:51 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 28/80] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:51 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:52 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:52 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:52 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:52 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:52 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] Creating event network-changed:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 20:57:52 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-d0173a4d-a5b5-460a-937b-8141c0e663a8 req-328c81ba-724a-4ca1-b945-3a341669df39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059096 Apr 18 20:57:52 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 26/81] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:53 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:53 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:57:53 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-a675eba4-3bf9-4fec-9483-3a3353764d42 req-0395185c-9057-439f-ab18-7b55eb324dea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047837 Apr 18 20:57:53 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 28/82] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:57:55 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=16 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:55 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "name": "network-vif-plugged", "status": "completed", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:55 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] Creating event network-vif-plugged:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:57:55 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-47ed41bf-ca6d-4395-86e1-44c693875fd4 req-8b620d95-c01a-4f4c-a570-266605bcfd4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060864 Apr 18 20:57:55 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 29/83] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=8 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=20 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "name": "network-vif-plugged", "status": "completed", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:57:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:57:57 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] Creating event network-vif-plugged:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:57:57 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-42984fdf-283b-43fb-a983-b2d27bb7539f req-ad61a9ac-6db3-4818-89ad-57c353ed285c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071481 Apr 18 20:57:57 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:57:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=20 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-99e3f320-857b-44ef-bba1-f650b06d991b tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Action: 'create', calling method: .version_select at 0x7f51d420f010>, body: {"keypair": {"name": "tempest-keypair-1254562589", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4K4jiBhwdBH4NYEm6XsMIMwgcE9OXszPKffO0tQ7ZLY26aAum3sBWuZH7jo4esVoKpUIb5N3erIFwr9wFu3NFSN6YCi+tTBIxL7Gd7r7FMnbTX4vohCbZ7V+SqN8CMNw=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=7 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-99e3f320-857b-44ef-bba1-f650b06d991b tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Getting quotas for project 92afe913f600401db1a67dbf41476e39. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:57:59 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-99e3f320-857b-44ef-bba1-f650b06d991b tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Getting quotas for user f69c8b0336c84623b99e18a499be822d and project 92afe913f600401db1a67dbf41476e39. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:57:59 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-99e3f320-857b-44ef-bba1-f650b06d991b tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.519777 Apr 18 20:57:59 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 29/85] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:57:59 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "name": "network-vif-plugged", "status": "completed", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=4 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:00 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=15 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] Creating event network-vif-plugged:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 20:58:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-fce56612-fc4c-4e17-a11b-d1edd69a2010 req-e1b4dc66-6559-4f49-9c6a-7e47ec5771d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.201090 Apr 18 20:58:00 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 30/86] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "name": "network-vif-plugged", "status": "completed", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=9 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:02 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=17 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:02 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] Creating event network-vif-plugged:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 20:58:02 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-001e3a32-44a8-4b2f-abd7-b4f9a93ac399 req-380a39c5-8c4f-424b-ad73-647764bb2418 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107220 Apr 18 20:58:02 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:03 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-46b67115-083c-47a2-b709-ef9be63d31e2 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Action: 'create', calling method: .version_select at 0x7f51d42545e0>, body: {"keypair": {"name": "tempest-keypair-1061000452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA2UTfG6vVC8VZyrzgJrr8dL7pFrUdlnyn6cKyItlJ6gPAtnwDrn5l+2vLKF+HCUfOvmM5ZhDwQBWXDRWFdUQxrl/PkTW5xVfjKAAmhbSfUFoy38VqYqZuoMvNXaXumzqw=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:03 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-46b67115-083c-47a2-b709-ef9be63d31e2 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for project cc1123ea88c041ed82b64c982aac6a35. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:03 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-46b67115-083c-47a2-b709-ef9be63d31e2 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for user e4224e9c1f5a47649dae0fd569edace2 and project cc1123ea88c041ed82b64c982aac6a35. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-46b67115-083c-47a2-b709-ef9be63d31e2 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.631119 Apr 18 20:58:03 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 30/88] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:58:03 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:04 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1327249685", "imageRef": "ae768640-151e-4f87-8a4c-05ba7b3ea304", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "64003b59-ca7e-47de-9f25-a8b8d06c81c7"}], "security_groups": [{"name": "tempest-securitygroup--270071236"}], "key_name": "tempest-keypair-1254562589", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:05 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] validate_networks() for [('64003b59-ca7e-47de-9f25-a8b8d06c81c7', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Getting quotas for project 92afe913f600401db1a67dbf41476e39. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Getting quotas for user f69c8b0336c84623b99e18a499be822d and project 92afe913f600401db1a67dbf41476e39. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:58:06 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae768640-151e-4f87-8a4c-05ba7b3ea304',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:58:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-a446c3de-ad18-4d27-b01f-5becfb0681ec tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 2.089669 Apr 18 20:58:06 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 31/89] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:58:04 2023] POST /compute/v2.1/servers => generated 403 bytes in 2091 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:58:06 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5b15cc50-f907-4aca-9d37-691a84852816 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:06 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-5b15cc50-f907-4aca-9d37-691a84852816 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:06 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-5b15cc50-f907-4aca-9d37-691a84852816 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69c8b0336c84623b99e18a499be822d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92afe913f600401db1a67dbf41476e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:06 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-5b15cc50-f907-4aca-9d37-691a84852816 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 200 len: 1240 microversion: 2.1 time: 0.148131 Apr 18 20:58:06 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 29/90] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:06 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 1240 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:07 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1520673597", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "1f06ea51-cc21-4201-9d4e-71c62d9b569e"}], "security_groups": [{"name": "tempest-securitygroup--315108181"}], "key_name": "tempest-keypair-1061000452", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:08 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] validate_networks() for [('1f06ea51-cc21-4201-9d4e-71c62d9b569e', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for project cc1123ea88c041ed82b64c982aac6a35. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for user e4224e9c1f5a47649dae0fd569edace2 and project cc1123ea88c041ed82b64c982aac6a35. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:58:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:58:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-d16310e5-8b47-49d0-8774-73047379b7d8 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.698174 Apr 18 20:58:09 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 31/91] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:58:07 2023] POST /compute/v2.1/servers => generated 403 bytes in 1700 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:58:09 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3e39e1cf-6827-446d-a487-3db77d7bf74b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:09 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-3e39e1cf-6827-446d-a487-3db77d7bf74b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:09 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-3e39e1cf-6827-446d-a487-3db77d7bf74b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:09 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-3e39e1cf-6827-446d-a487-3db77d7bf74b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710" status: 200 len: 1236 microversion: 2.1 time: 0.086648 Apr 18 20:58:09 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 32/92] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:09 2023] GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:12 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:12 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:12 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] Creating event network-changed:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 20:58:12 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-ecfa3ff4-0d4c-4e1a-ba8f-87ebc9346fe8 req-f60317a7-6519-4efd-94eb-be1aefa76b73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045701 Apr 18 20:58:12 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 30/93] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] Creating event network-changed:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 20:58:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-56873eb6-d804-44ab-977d-e8db7786956c req-14af3e7b-68c6-46ff-99df-1c4954515bcd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036424 Apr 18 20:58:15 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 32/94] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:15 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c0e46f31-aee3-4664-b0b6-94f30f4390d6 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Action: 'create', calling method: .version_select at 0x7f51d420ecb0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1226279593", "metadata": {"Type": "work"}}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:16 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c0e46f31-aee3-4664-b0b6-94f30f4390d6 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.573571 Apr 18 20:58:16 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 33/95] 10.0.0.210 () {64 vars in 1233 bytes} [Tue Apr 18 20:58:15 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 575 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 18 20:58:16 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b78421fe-711d-4bdb-909b-f3f5893e1bac tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Calling method '.version_select at 0x7f51d4bcb2e0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:16 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-b78421fe-711d-4bdb-909b-f3f5893e1bac tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731" status: 200 len: 350 microversion: 2.1 time: 0.060658 Apr 18 20:58:16 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "name": "network-vif-plugged", "status": "completed", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:16 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 31/96] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:58:16 2023] GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731 => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] Creating event network-vif-plugged:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 20:58:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-f339c689-adb0-4bdb-8a84-e9801fab9988 req-e7ceda40-b9aa-49f4-aa7e-803a0500c31b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031764 Apr 18 20:58:16 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 33/97] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-0591cac2-0e96-44d7-9618-259952fa9a76 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Calling method '.version_select at 0x7f51d420e440>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:17 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-0591cac2-0e96-44d7-9618-259952fa9a76 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731" status: 200 len: 350 microversion: 2.1 time: 0.068579 Apr 18 20:58:17 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 34/98] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:58:17 2023] GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731 => generated 350 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-d03be4ec-80e3-4ca8-ad02-e1f13f34a4aa tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Calling method '.version_select at 0x7f51d4bca5f0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:17 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-d03be4ec-80e3-4ca8-ad02-e1f13f34a4aa tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731" status: 202 len: 0 microversion: 2.1 time: 0.169186 Apr 18 20:58:17 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 32/99] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 20:58:17 2023] DELETE /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:58:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6e828a8a-52e4-4129-a8c9-cfdcfc5703f1 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Calling method '.version_select at 0x7f51d420fc70>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:17 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-6e828a8a-52e4-4129-a8c9-cfdcfc5703f1 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] HTTP exception thrown: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. Apr 18 20:58:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6e828a8a-52e4-4129-a8c9-cfdcfc5703f1 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Request method failure captured: Apr 18 20:58:17 user devstack@n-api.service[61133]: request: GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731 HTTP/1.1 Apr 18 20:58:17 user devstack@n-api.service[61133]: Accept: application/json Apr 18 20:58:17 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 20:58:17 user devstack@n-api.service[61133]: Connection: close Apr 18 20:58:17 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 20:58:17 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 20:58:17 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 20:58:17 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 20:58:17 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRn2tJX-G-YaRKiM3wdt8KnvuZhRrsCT01v1UTbvmm-9xgKZmjJTV0c99O3ZWgCdECT4SPd3ffyG737st0yt07mGrLF7SMG6nO1BFv9oGa_x1ZNNARJekXQTUAJ39Sra5MwvwTYh9TFBTLsHkfLBEAxnWZ73vA3Hlb7_hma7qf_TMY Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Project-Id: f78781bd8eff411d805362e1c7394485 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Project-Name: tempest-VolumesGetTestJSON-1075274898 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f78781bd8eff411d805362e1c7394485"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f78781bd8eff411d805362e1c7394485"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f78781bd8eff411d805362e1c7394485"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Tenant: tempest-VolumesGetTestJSON-1075274898 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Tenant-Id: f78781bd8eff411d805362e1c7394485 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-VolumesGetTestJSON-1075274898 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-User: tempest-VolumesGetTestJSON-1075274898-project-member Apr 18 20:58:17 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 20:58:17 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 20:58:17 user devstack@n-api.service[61133]: X-User-Id: d1f8f6a96c31402b9caa5596a3355be1 Apr 18 20:58:17 user devstack@n-api.service[61133]: X-User-Name: tempest-VolumesGetTestJSON-1075274898-project-member Apr 18 20:58:17 user devstack@n-api.service[61133]: method: Apr 18 20:58:17 user devstack@n-api.service[61133]: exception: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. Apr 18 20:58:17 user devstack@n-api.service[61133]: action_args: {'id': 'f8cb642e-5735-4933-b37e-61537c014731'} Apr 18 20:58:17 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. (HTTP 404) (Request-ID: req-44e54a65-81d6-415d-b5a4-74e87bbe0077) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. Apr 18 20:58:17 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 20:58:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6e828a8a-52e4-4129-a8c9-cfdcfc5703f1 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] Returning 404 to user: Volume f8cb642e-5735-4933-b37e-61537c014731 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 20:58:17 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-6e828a8a-52e4-4129-a8c9-cfdcfc5703f1 tempest-VolumesGetTestJSON-1075274898 tempest-VolumesGetTestJSON-1075274898-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731" status: 404 len: 109 microversion: 2.1 time: 0.039397 Apr 18 20:58:17 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 34/100] 10.0.0.210 () {62 vars in 1322 bytes} [Tue Apr 18 20:58:17 2023] GET /compute/v2.1/os-volumes/f8cb642e-5735-4933-b37e-61537c014731 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 20:58:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "name": "network-vif-plugged", "status": "completed", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}, {"server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "name": "network-vif-plugged", "status": "completed", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}, {"server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "name": "network-vif-plugged", "status": "completed", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Creating event network-vif-plugged:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 20:58:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Creating event network-vif-plugged:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 20:58:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] Creating event network-vif-plugged:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 20:58:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-e0cd1d4e-ab83-4277-8c8f-490df5463403 req-b01cefa9-4f62-4f5d-b890-1a4d8fc0e799 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053939 Apr 18 20:58:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 35/101] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:18 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:20 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:20 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:20 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:20 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-21f33147-08a2-426a-85fb-d304a26a0a8b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 200 len: 1690 microversion: 2.87 time: 0.593854 Apr 18 20:58:20 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 33/102] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:58:19 2023] GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 1690 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=14 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:22 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771843bc852b4922a50056eab2be979d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8f3ac2c484400fbfcbf466d3a57f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:22 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-ecbc7803-e33e-4d93-bb42-4114ac1879a5 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251" status: 200 len: 1489 microversion: 2.1 time: 0.493496 Apr 18 20:58:22 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 35/103] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:21 2023] GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 => generated 1489 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:23 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=8 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:23 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3c349bd1-a1e4-4abe-909c-4d72676787b5 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: .version_select at 0x7f51d420e7a0>, body: {"keypair": {"name": "tempest-keypair-1949563291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMDSx2t8c93OTuOOVYRjpGMsUnBHn3H2UxZGDfPdKbmRrWXN19Wx3EMFSgqPuYB1iKJPyPRYHKjQv8B3R7BVboj9FYnrQgSPcVoJ7DL1tlRvtVx265Gk5WO0uj872TGR4A=="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:23 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-3c349bd1-a1e4-4abe-909c-4d72676787b5 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:23 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-3c349bd1-a1e4-4abe-909c-4d72676787b5 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-3c349bd1-a1e4-4abe-909c-4d72676787b5 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229951 Apr 18 20:58:23 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 36/104] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:58:23 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:26 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-248362096", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3b319de-2fa3-4858-b85a-891d6736ed6b"}], "security_groups": [{"name": "tempest-securitygroup--1323471069"}], "key_name": "tempest-keypair-1949563291", "user_data": "}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:26 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] validate_networks() for [('c3b319de-2fa3-4858-b85a-891d6736ed6b', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:58:26 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:26 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-85a47460-3fc1-40b7-81e2-2880c501d959 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 200 len: 1504 microversion: 2.1 time: 0.585061 Apr 18 20:58:26 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 36/105] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:26 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:58:27 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:58:27 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-daed4111-eef5-43bf-8116-142a6c1f8a0e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.589203 Apr 18 20:58:27 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 34/106] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:58:25 2023] POST /compute/v2.1/servers => generated 400 bytes in 1592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:58:27 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-124651d3-89d8-4e42-9141-b5c76da99163 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:27 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-124651d3-89d8-4e42-9141-b5c76da99163 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:27 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-124651d3-89d8-4e42-9141-b5c76da99163 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-124651d3-89d8-4e42-9141-b5c76da99163 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 200 len: 1235 microversion: 2.1 time: 0.127054 Apr 18 20:58:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 37/107] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:27 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 1235 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:31 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:31 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=5 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] Creating event network-changed:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 20:58:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-07ad6e48-57b4-4681-bdc9-e29ec193e78e req-ff909160-320d-461f-9afa-eaf7629d3878 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040271 Apr 18 20:58:31 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 37/108] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:34 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "name": "network-vif-plugged", "status": "completed", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] Creating event network-vif-plugged:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 20:58:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-d80a49b9-fec4-4a29-b7c5-f54a955f54c8 req-c5fe7cbd-800a-4311-86a9-cfc1b3f0bac7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Apr 18 20:58:34 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 35/109] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:34 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=4 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:34 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:34 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d2c5e20a-6f71-4f12-9059-0589f6d3744f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 200 len: 1586 microversion: 2.20 time: 0.821246 Apr 18 20:58:34 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 38/110] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:58:34 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 1586 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:34 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=21 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:35 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9856fa4dcb9d407bbeb0952587500917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f30bf556984db19a19b918133d0ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:35 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-4f624a7c-b127-4aae-a7ec-a99f6960a45f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 200 len: 1552 microversion: 2.1 time: 0.328471 Apr 18 20:58:35 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 38/111] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:34 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 1552 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:36 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "name": "network-vif-plugged", "status": "completed", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] Creating event network-vif-plugged:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 20:58:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-fc1726c5-8bc9-4467-bdfd-19c41e809bac req-def85d5d-3095-4bb7-8f1b-f6950619f078 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029207 Apr 18 20:58:36 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 36/112] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e74a6862-5c64-4346-a7d4-f00020ba4d46 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Action: 'create', calling method: .version_select at 0x7f51d4298160>, body: {"keypair": {"name": "tempest-keypair-784894121", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEmEJaOIYGF9zpIwZyrztcU36MPpI6XkafWbKiM1Gauikf92UFMA1ctpcsoc2YjX6Tn/nkBI99CuNwTrZ0uQpFAad0tQMup08gmx1ZJfPjjkaCZ2engDJQ/LB75N0Jvlfw=="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-e74a6862-5c64-4346-a7d4-f00020ba4d46 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Getting quotas for project e745786188a8467e91ee32d4078f12b5. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:52 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-e74a6862-5c64-4346-a7d4-f00020ba4d46 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Getting quotas for user e035553eec70421e9b8dc1eff337b4a5 and project e745786188a8467e91ee32d4078f12b5. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:52 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e74a6862-5c64-4346-a7d4-f00020ba4d46 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.215998 Apr 18 20:58:52 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 39/113] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:58:52 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 20:58:54 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-385646295", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c1c45596-8e7e-4402-94ac-23c5f3c56ddd"}], "security_groups": [{"name": "tempest-securitygroup--803577880"}], "key_name": "tempest-keypair-784894121", "user_data": "}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:54 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:54 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=5 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:54 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] validate_networks() for [('c1c45596-8e7e-4402-94ac-23c5f3c56ddd', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Getting quotas for project e745786188a8467e91ee32d4078f12b5. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Getting quotas for user e035553eec70421e9b8dc1eff337b4a5 and project e745786188a8467e91ee32d4078f12b5. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 20:58:55 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 20:58:55 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-8a313d56-1999-41ea-a6ed-f6f5e5915fe6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911026 Apr 18 20:58:55 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 39/114] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 20:58:54 2023] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=14 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-320ccfd2-7478-4a3f-9a83-7420d8685477 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-320ccfd2-7478-4a3f-9a83-7420d8685477 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:55 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-320ccfd2-7478-4a3f-9a83-7420d8685477 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:55 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-320ccfd2-7478-4a3f-9a83-7420d8685477 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1231 microversion: 2.1 time: 0.091009 Apr 18 20:58:55 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 37/115] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:55 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:57 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69c8b0336c84623b99e18a499be822d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92afe913f600401db1a67dbf41476e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:58:57 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-2a1856c2-4066-4807-ae8a-4fb5c39d1dc8 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 200 len: 1549 microversion: 2.1 time: 0.376625 Apr 18 20:58:57 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 40/116] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:57 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 1549 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:58:59 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:58:59 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:59 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:59 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:59 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] Creating event network-changed:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 20:58:59 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-0ee280c9-4578-430a-bf0e-099fbc39ce06 req-2520d14c-e000-48fe-a52f-95903bc07ab6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028616 Apr 18 20:58:59 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 40/117] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:58:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:58:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:00 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:00 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-837ed7ec-2e4a-42ba-8664-438a866869f1 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710" status: 200 len: 1546 microversion: 2.1 time: 0.419199 Apr 18 20:59:00 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 38/118] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:58:59 2023] GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 => generated 1546 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:59:01 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "name": "network-vif-plugged", "status": "completed", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] Creating event network-vif-plugged:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 20:59:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-f1e9586d-3428-400c-a3d5-cea91853e354 req-64301b30-bc70-4fb6-8cb5-e3039e087fb8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.234384 Apr 18 20:59:02 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 41/119] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-1d0ce15f-1711-4f8a-9b10-0eda45002a1e tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] Action: 'create', calling method: .version_select at 0x7f51d42a7e20>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1961281035", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiVTKLwhmWie1dfJqdPFrQ7EXKrs2a0+yrfE+Ig7hpgBgkWmsFyJQSLru+xmvg65GdMN6lEk98cCJ+SOcj5rgO9q8ex01M1CwUsGMawBK1tTbnT/vEpazSzMUIGdBhJWw=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:02 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-1d0ce15f-1711-4f8a-9b10-0eda45002a1e tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] Getting quotas for project 143d281f167f413aa6fae6fdac5163b2. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 20:59:02 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-1d0ce15f-1711-4f8a-9b10-0eda45002a1e tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] Getting quotas for user 59446a4ac29744ca89d266a56d9abe9c and project 143d281f167f413aa6fae6fdac5163b2. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 20:59:02 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-1d0ce15f-1711-4f8a-9b10-0eda45002a1e tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.041924 Apr 18 20:59:02 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 41/120] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 20:59:02 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:04 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "name": "network-vif-plugged", "status": "completed", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] Creating event network-vif-plugged:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 20:59:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-cda3c22d-2fe5-4510-9e6b-d19fcbefb98d req-203ddbff-ea3c-4ce2-83d4-8ff4b081687a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027471 Apr 18 20:59:04 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 39/121] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-7f4f7ac4-b2ac-407f-a92f-49b674ca3131 tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] Calling method '.version_select at 0x7f51d5645900>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:06 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=4 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-7f4f7ac4-b2ac-407f-a92f-49b674ca3131 tempest-TestVolumeBootPattern-1902588759 tempest-TestVolumeBootPattern-1902588759-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1961281035" status: 202 len: 0 microversion: 2.1 time: 0.026926 Apr 18 20:59:06 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 42/122] 10.0.0.210 () {62 vars in 1340 bytes} [Tue Apr 18 20:59:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1961281035 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:18 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-c340fc91-421a-472a-949d-fabff1307e6e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 200 len: 1546 microversion: 2.1 time: 0.237469 Apr 18 20:59:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 42/123] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:59:17 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 1546 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=8 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=8 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-985498932"}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:21 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-653b5cea-cdfc-4fa7-868e-0d1f5961debd tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c/action" status: 202 len: 52 microversion: 2.87 time: 0.940844 Apr 18 20:59:21 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 40/124] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 20:59:20 2023] POST /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c/action => generated 52 bytes in 943 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=8 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=18,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:24 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:59:24 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-2d541f09-11c5-4bb3-9bd6-5f1005e226ee tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251" status: 204 len: 0 microversion: 2.1 time: 0.181294 Apr 18 20:59:24 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 43/125] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:59:23 2023] DELETE /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:24 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "name": "network-vif-unplugged", "status": "completed", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:24 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:24 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:24 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:24 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] Creating event network-vif-unplugged:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:59:24 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-37d16c67-8ee5-43a9-980a-0e502c3a3f5e req-ce89de14-49c7-4d1c-b722-6a044e77719f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032352 Apr 18 20:59:24 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 41/126] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:24 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '771843bc852b4922a50056eab2be979d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e8f3ac2c484400fbfcbf466d3a57f2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:24 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-464d4a4d-6b4a-489e-be1c-41586fa4fab7 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251" status: 200 len: 1495 microversion: 2.1 time: 0.303615 Apr 18 20:59:24 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 43/127] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:59:24 2023] GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 => generated 1495 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "name": "network-vif-deleted", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:26 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] Creating event network-vif-deleted:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:59:26 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-03f2cfbb-4d38-41c0-bf7a-5d5b399e1779 req-d66ff2e5-c24e-42a0-a2ca-ff23e4c041c7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029060 Apr 18 20:59:26 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 44/128] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:26 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d69610c-9155-4ab6-9f26-f8412e6ec251", "name": "network-vif-plugged", "status": "completed", "tag": "f1c84dae-fdb3-47a0-b8a7-5ecf161265c0"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:26 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] Creating event network-vif-plugged:f1c84dae-fdb3-47a0-b8a7-5ecf161265c0 for instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 on user Apr 18 20:59:26 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-cd926478-c42a-4b7e-bd29-c95b5452592b req-2fe3aba6-36e8-48a6-a673-0503dd96dcf4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028138 Apr 18 20:59:26 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 44/129] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:26 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:26 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-5025bfcc-656e-4639-97cd-a6ad8538f8e2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 200 len: 1690 microversion: 2.87 time: 0.372790 Apr 18 20:59:26 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 42/130] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:59:26 2023] GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 1690 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:27 user devstack@n-api.service[61135]: DEBUG nova.objects.instance [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lazy-loading 'flavor' on Instance uuid 41cadb33-a43a-4098-b21a-42901102779f {{(pid=61135) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 20:59:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c137a8bb-6d38-4957-8634-ec84ff5683c4 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "POST /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f/action" status: 200 len: 32 microversion: 2.1 time: 0.137299 Apr 18 20:59:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 45/131] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 20:59:26 2023] POST /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f/action => generated 32 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:27 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:27 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-6bbb96b0-c4c4-4127-b987-7994b036a2be tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 200 len: 1510 microversion: 2.1 time: 0.405154 Apr 18 20:59:27 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 45/132] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:59:27 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 1510 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:59:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-unplugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}, {"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Creating event network-vif-unplugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:59:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:59:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-263daf83-7a47-4e43-9cae-ed90dc0b7683 req-02e0dffb-85d9-43a7-9a0b-6945046f8f66 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.048870 Apr 18 20:59:28 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 43/133] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:28 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:30 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:30 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:30 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:30 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:30 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:59:30 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-f1362acc-98a7-444f-92ee-455732384f07 req-0e700567-a34f-4f98-87b1-aeecc91a4524 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028080 Apr 18 20:59:30 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 46/134] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:32 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:32 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 20:59:32 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-f0580903-6131-47f0-a427-623abf64330a req-11082a3f-cc18-457e-a11f-702db8cfa8dc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027003 Apr 18 20:59:32 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 46/135] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:35 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:35 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-3fa62002-3542-418f-96f1-134ab9be6aba tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.162075 Apr 18 20:59:35 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 44/136] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 20:59:35 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56/os-interface => generated 282 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:35 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:35 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-9e143279-d629-44ad-ada2-b3e8dc499197 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.416000 Apr 18 20:59:35 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 47/137] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:59:35 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2/os-interface => generated 282 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:36 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:36 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] Creating event network-changed:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:59:36 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-38e2875c-04e5-4179-9f2e-06ba51199aae req-f5d225c7-4a39-4cb6-aa93-8bf1d5e22e75 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036860 Apr 18 20:59:36 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 47/138] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-c678449c-8b24-485e-8db5-ef054685e1c6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56/ips" status: 200 len: 110 microversion: 2.20 time: 0.039462 Apr 18 20:59:36 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 45/139] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 20:59:36 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56/ips => generated 110 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 20:59:37 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:37 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:37 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:37 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:37 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] Creating event network-changed:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 20:59:37 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-c3ff86f2-ed14-4ca8-8c46-6796b76e80d5 req-b51a6aee-9b64-47cb-bf0b-88aca5d4c9ae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034008 Apr 18 20:59:37 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 48/140] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-1894514503"}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-edf51c27-7417-4002-9a33-9a3abcb7839f tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2/action" status: 202 len: 0 microversion: 2.1 time: 0.817022 Apr 18 20:59:38 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 48/141] 10.0.0.210 () {64 vars in 1355 bytes} [Tue Apr 18 20:59:37 2023] POST /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 18 20:59:38 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-21a175f1-400b-4fc2-bc14-ffff7e1dd97c tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '.version_select at 0x7f51d421d1b0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:38 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-21a175f1-400b-4fc2-bc14-ffff7e1dd97c tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c" status: 200 len: 1611 microversion: 2.1 time: 0.050665 Apr 18 20:59:38 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 46/142] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 20:59:38 2023] GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c => generated 1611 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:59:38 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-ea79b880-5580-4288-9078-b29eb7cffa75 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 204 len: 0 microversion: 2.20 time: 0.111264 Apr 18 20:59:38 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 49/143] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 20:59:38 2023] DELETE /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:38 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-9109a974-2050-4b11-8014-688b5442b60e tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 200 len: 1711 microversion: 2.20 time: 0.168914 Apr 18 20:59:38 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 49/144] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 20:59:38 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 1711 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 20:59:38 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "name": "network-vif-unplugged", "status": "completed", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:38 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] Creating event network-vif-unplugged:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:59:38 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-28ed8f89-78b6-47cc-a232-e91614604486 req-f47ee31e-2f41-4ce6-9299-c3bc656d359b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039938 Apr 18 20:59:38 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:40 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "name": "network-vif-plugged", "status": "completed", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:40 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] Creating event network-vif-plugged:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:59:40 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-21240a70-f333-4dbe-a9c3-f50fd6945341 req-189dc2f3-9039-4372-946d-2142ceeb0758 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029138 Apr 18 20:59:40 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 50/146] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:41 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b9d151c-45d7-4172-ace6-65d16d94ae56", "name": "network-vif-deleted", "tag": "356e9511-a8a0-4055-922d-f1784906921e"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:41 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] Creating event network-vif-deleted:356e9511-a8a0-4055-922d-f1784906921e for instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 on user Apr 18 20:59:41 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-ed51ca35-6aa5-444c-a944-80022f6eb056 req-5f374271-df9e-4c32-b2d6-dfc8c1803954 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182591 Apr 18 20:59:41 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 50/147] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:45 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 20:59:45 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-4f1a4aac-6d81-4d8d-8199-d05626b7f031 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1538 microversion: 2.1 time: 0.222655 Apr 18 20:59:45 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 48/148] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:59:45 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1538 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:57 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-7e99e6c1-f4f0-4ebe-bfce-580c0b3c6e48 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.199250 Apr 18 20:59:57 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 51/149] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 20:59:57 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11/os-interface => generated 283 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=18 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:58 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:58 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] Creating event network-changed:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 20:59:58 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-ce462b2a-5f6a-4f7b-ad4c-f1efb837a44e req-764539f0-351f-4f97-9450-b36b6e214298 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039602 Apr 18 20:59:58 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 51/150] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 20:59:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=18 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:59 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 20:59:59 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-0915919d-9cde-4c58-8874-c30fba8fbf3f tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 204 len: 0 microversion: 2.1 time: 0.141942 Apr 18 20:59:59 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 49/151] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 20:59:59 2023] DELETE /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 20:59:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:00 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f69c8b0336c84623b99e18a499be822d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92afe913f600401db1a67dbf41476e39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e94d066c-8748-475e-bcf4-dda794929d7c tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 200 len: 1673 microversion: 2.1 time: 0.246119 Apr 18 21:00:00 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 52/152] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 20:59:59 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 1673 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:00 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0b1a817c-2ce3-4131-8500-cdf2cac8af03 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.160916 Apr 18 21:00:00 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 52/153] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:00:00 2023] GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710/os-interface => generated 283 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:00 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "name": "network-vif-unplugged", "status": "completed", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:00 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] Creating event network-vif-unplugged:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 21:00:00 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-2c909bac-54d4-46fb-b1a2-7c4154df3f8b req-9f995c20-24be-4454-8be7-0e9392061731 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042364 Apr 18 21:00:00 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 50/154] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:01 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:01 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:01 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] Creating event network-changed:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 21:00:01 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-3bd093d1-27d4-441d-9f2a-1e8934292c35 req-60809a39-7058-4fba-9948-0a9093fb1825 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037978 Apr 18 21:00:01 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 53/155] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:01 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "name": "network-vif-deleted", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:01 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:01 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:01 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:01 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] Creating event network-vif-deleted:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 21:00:01 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-0fcbf90b-59ff-4eb5-add4-8c2306c01336 req-edb13e48-d264-437f-91fc-237536e8a322 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Apr 18 21:00:01 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 53/156] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:02 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e4bd7e5-d295-48a4-a218-77396df75c11", "name": "network-vif-plugged", "status": "completed", "tag": "f5008b3e-15d9-4809-98f3-d4a8911a27e0"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:02 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:02 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] Creating event network-vif-plugged:f5008b3e-15d9-4809-98f3-d4a8911a27e0 for instance 9e4bd7e5-d295-48a4-a218-77396df75c11 on user Apr 18 21:00:02 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-926e656c-8039-426e-b240-0f9ebe2e140c req-056f5430-5d19-4d05-bfda-e382b667fc51 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028445 Apr 18 21:00:02 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 51/157] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-424829948", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "1f06ea51-cc21-4201-9d4e-71c62d9b569e"}]}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:02 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] validate_networks() for [('1f06ea51-cc21-4201-9d4e-71c62d9b569e', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for project cc1123ea88c041ed82b64c982aac6a35. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Getting quotas for user e4224e9c1f5a47649dae0fd569edace2 and project cc1123ea88c041ed82b64c982aac6a35. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:00:03 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:00:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-2e2fe8c2-e57f-4670-9361-d93cc2e9bd88 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.565735 Apr 18 21:00:03 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 54/158] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:00:02 2023] POST /compute/v2.1/servers => generated 378 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:00:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-57120491-3382-4573-b300-9714053ee36a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:03 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-57120491-3382-4573-b300-9714053ee36a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:03 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-57120491-3382-4573-b300-9714053ee36a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-57120491-3382-4573-b300-9714053ee36a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68" status: 200 len: 1211 microversion: 2.1 time: 0.082251 Apr 18 21:00:03 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 54/159] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:03 2023] GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 => generated 1211 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:06 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:06 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] Creating event network-changed:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:00:06 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-8b3d4d7c-45ac-4e2c-be52-b4fa06771d06 req-288ab767-d6ef-4dbe-a5c4-5fe82d4b771b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031441 Apr 18 21:00:06 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 52/160] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:08 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "name": "network-vif-plugged", "status": "completed", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:08 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] Creating event network-vif-plugged:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:00:08 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-18adb348-3074-4497-8ff9-b3d32c99f0b5 req-d5fcb5ed-6742-43f8-b424-0c328c7701da service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031626 Apr 18 21:00:08 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 55/161] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:10 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "name": "network-vif-plugged", "status": "completed", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] Creating event network-vif-plugged:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:00:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-c0d3f474-e393-41fc-a377-caf44037f5af req-d0be72d4-c68b-4100-98eb-c8c47d8106d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060579 Apr 18 21:00:10 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 55/162] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] [instance: 3d69610c-9155-4ab6-9f26-f8412e6ec251] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] HTTP exception thrown: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Request method failure captured: Apr 18 21:00:14 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 HTTP/1.1 Apr 18 21:00:14 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:00:14 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:00:14 user devstack@n-api.service[61134]: Connection: close Apr 18 21:00:14 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:00:14 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:00:14 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:00:14 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:00:14 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQ4AiIDr31-SrF_zvoIHfJndhPCPDAgZ7tUqEwXb7cAKp5h55agbZv5__NEfAfDPHksO4KtBTBtr7gqRIaA0qRaqwtytyIb_5FW2BdIfBAoCeYW7MtT1ruKtb66bXOTzVmDgZhkCiQLnMMVhyuTQlsdHddKQ9L64YrdinGwpg1FLT0 Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Project-Id: 9e8f3ac2c484400fbfcbf466d3a57f2f Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Project-Name: tempest-DeleteServersTestJSON-208160443 Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8f3ac2c484400fbfcbf466d3a57f2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/9e8f3ac2c484400fbfcbf466d3a57f2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/9e8f3ac2c484400fbfcbf466d3a57f2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Tenant: tempest-DeleteServersTestJSON-208160443 Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Tenant-Id: 9e8f3ac2c484400fbfcbf466d3a57f2f Apr 18 21:00:14 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-DeleteServersTestJSON-208160443 Apr 18 21:00:14 user devstack@n-api.service[61134]: X-User: tempest-DeleteServersTestJSON-208160443-project-member Apr 18 21:00:14 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:00:14 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:00:14 user devstack@n-api.service[61134]: X-User-Id: 771843bc852b4922a50056eab2be979d Apr 18 21:00:14 user devstack@n-api.service[61134]: X-User-Name: tempest-DeleteServersTestJSON-208160443-project-member Apr 18 21:00:14 user devstack@n-api.service[61134]: method: > Apr 18 21:00:14 user devstack@n-api.service[61134]: exception: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. Apr 18 21:00:14 user devstack@n-api.service[61134]: action_args: {'id': '3d69610c-9155-4ab6-9f26-f8412e6ec251'} Apr 18 21:00:14 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. Apr 18 21:00:14 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] Returning 404 to user: Instance 3d69610c-9155-4ab6-9f26-f8412e6ec251 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:00:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-b58214bd-ee4c-42a9-99ac-e389bb82b247 tempest-DeleteServersTestJSON-208160443 tempest-DeleteServersTestJSON-208160443-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251" status: 404 len: 111 microversion: 2.1 time: 0.034587 Apr 18 21:00:14 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 53/163] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:14 2023] GET /compute/v2.1/servers/3d69610c-9155-4ab6-9f26-f8412e6ec251 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:17 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:17 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d3c11305-c127-444f-ab70-f34023ef81c9 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 200 len: 1490 microversion: 2.1 time: 0.220825 Apr 18 21:00:17 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 56/164] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:17 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 1490 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-7fcc891f-d7ae-4444-85a3-4b7dafe7dfae tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.212262 Apr 18 21:00:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 56/165] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:00:18 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b/os-interface => generated 283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] Creating event network-changed:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 21:00:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-a49727f2-48bd-4248-abc3-6d2da41be14a req-4f1b0bba-43ec-443a-ad18-8ffd0bd8c610 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040849 Apr 18 21:00:19 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 54/166] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:19 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-10db2f6c-8511-4e4f-b1b3-90e42f633f29 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b/ips" status: 200 len: 109 microversion: 2.1 time: 0.036036 Apr 18 21:00:19 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 57/167] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:00:19 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b/ips => generated 109 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:20 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:00:20 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-aac59e5d-6644-4c2c-ae87-c618d4e062e1 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 204 len: 0 microversion: 2.1 time: 0.156736 Apr 18 21:00:20 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 57/168] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:00:20 2023] DELETE /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:20 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:20 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-8262d3ce-9ab1-4083-9c39-ae4b9cbbe0dc tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 200 len: 1670 microversion: 2.1 time: 0.185465 Apr 18 21:00:20 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 55/169] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:20 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 1670 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "name": "network-vif-unplugged", "status": "completed", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] Creating event network-vif-unplugged:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 21:00:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-8ea22dee-af65-4737-ad12-8cc660b7a865 req-3c8ee36c-f688-461c-9749-95c051d713a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035512 Apr 18 21:00:21 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 58/170] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:22 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "name": "network-vif-deleted", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:23 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] Creating event network-vif-deleted:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 21:00:23 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-ce7e8e46-a045-448b-8b03-f3d150db8ec7 req-ab39ff8e-c334-4922-ba57-db13576c7b94 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060622 Apr 18 21:00:23 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 58/171] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:23 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12094087-b11e-4575-b6b3-09fb4091588b", "name": "network-vif-plugged", "status": "completed", "tag": "b693a48f-eb48-46e8-910c-1112960e66b6"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] Creating event network-vif-plugged:b693a48f-eb48-46e8-910c-1112960e66b6 for instance 12094087-b11e-4575-b6b3-09fb4091588b on user Apr 18 21:00:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-1fb1ade7-4941-43b1-a9f3-4c578959d15a req-7ba1f388-a001-44c2-88eb-cf099294d474 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034757 Apr 18 21:00:23 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 56/172] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:26 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-913311237", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "2a459fb0-36eb-4c75-afd7-0de7482741f7"}]}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:26 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1545986707", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "510b5b0f-6710-4d7a-a4fd-24afdc62981e"}]}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:27 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] validate_networks() for [('2a459fb0-36eb-4c75-afd7-0de7482741f7', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] validate_networks() for [('510b5b0f-6710-4d7a-a4fd-24afdc62981e', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Getting quotas for project e102abbb675645edbbd042f775e89e50. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Getting quotas for user b36a393d92e948b1ada87c4823d14bee and project e102abbb675645edbbd042f775e89e50. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:00:27 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:00:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-8de8f69a-af20-4283-9d01-70e62a49ee80 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.733856 Apr 18 21:00:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 59/173] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:00:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 736 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:00:27 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-d152e0e5-1cfb-4da9-b8b8-e8d2c0e42c79 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:27 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-d152e0e5-1cfb-4da9-b8b8-e8d2c0e42c79 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-d152e0e5-1cfb-4da9-b8b8-e8d2c0e42c79 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-d152e0e5-1cfb-4da9-b8b8-e8d2c0e42c79 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1211 microversion: 2.1 time: 0.438561 Apr 18 21:00:28 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 57/174] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:27 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1211 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for user e6caad8bd6fe44b6ab8868167473d4fe and project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-82e17c30-f7d7-40e2-aee2-f3c48453cfbf tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '.version_select at 0x7f51d42de5f0>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-381eac1a-91fd-4588-a45d-a5b42b240b16 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 1.300422 Apr 18 21:00:28 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 59/175] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 21:00:26 2023] POST /compute/v2.1/servers => generated 378 bytes in 1302 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:28 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-82e17c30-f7d7-40e2-aee2-f3c48453cfbf tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c" status: 200 len: 1725 microversion: 2.1 time: 0.054371 Apr 18 21:00:28 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 60/176] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 21:00:28 2023] GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c => generated 1725 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-adcb54c4-2b07-4348-a2f8-b0f9d57deff9 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '.version_select at 0x7f51d42a79a0>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-eeecfb11-9452-4856-b0a5-7f30e776ef33 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78" status: 200 len: 1394 microversion: 2.87 time: 0.078997 Apr 18 21:00:28 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 58/177] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:00:28 2023] GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78 => generated 1394 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-adcb54c4-2b07-4348-a2f8-b0f9d57deff9 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c" status: 200 len: 1725 microversion: 2.1 time: 0.052883 Apr 18 21:00:28 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 60/178] 10.0.0.210 () {62 vars in 1310 bytes} [Tue Apr 18 21:00:28 2023] GET /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c => generated 1725 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=31 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:28 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9856fa4dcb9d407bbeb0952587500917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f30bf556984db19a19b918133d0ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:28 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-1103eb15-ae68-432c-b2e6-c9d92b2f9a75 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 200 len: 1671 microversion: 2.1 time: 0.246766 Apr 18 21:00:28 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 61/179] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:28 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 1671 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:00:28 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 HTTP/1.1 Apr 18 21:00:28 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:00:28 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:00:28 user devstack@n-api.service[61134]: Connection: close Apr 18 21:00:28 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:00:28 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:00:28 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:00:28 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:00:28 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:00:28 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:00:28 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:00:28 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:00:28 user devstack@n-api.service[61134]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:00:28 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:00:28 user devstack@n-api.service[61134]: method: > Apr 18 21:00:28 user devstack@n-api.service[61134]: exception: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:00:28 user devstack@n-api.service[61134]: action_args: {'id': '8b9d151c-45d7-4172-ace6-65d16d94ae56'} Apr 18 21:00:28 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:00:28 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:00:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:00:28 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-631a5522-97bd-4c65-bcbc-ee9c83e98e57 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 404 len: 111 microversion: 2.20 time: 0.029174 Apr 18 21:00:28 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 59/180] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:00:28 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-3e83cc3e-6b10-4905-ad33-1d03222847af tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '.version_select at 0x7f51d42fbd00>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:28 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-3e83cc3e-6b10-4905-ad33-1d03222847af tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929553880" status: 204 len: 0 microversion: 2.20 time: 0.028697 Apr 18 21:00:28 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 61/181] 10.0.0.210 () {64 vars in 1339 bytes} [Tue Apr 18 21:00:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1929553880 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:00:29 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-39e7c356-002f-4d13-a7d8-2ec057645266 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Action: 'create', calling method: .version_select at 0x7f51d42de290>, body: {"keypair": {"name": "tempest-keypair-315105593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZ2K3cnNvtjFZ6HCKgpzPCuqfThj3QLNRcRUQif05prRTUe+ZE5sgWLZbHRFypvm4YPzpVRg9plZ0PSJO8LQbnjNL1mPHV0HWvnbOZmAlfq1Umae4NgcpO4sL4itMdguQ=="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:29 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-39e7c356-002f-4d13-a7d8-2ec057645266 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:00:29 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-39e7c356-002f-4d13-a7d8-2ec057645266 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for user 220589b8afc240778bff63d1e5ce20d1 and project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:00:29 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-39e7c356-002f-4d13-a7d8-2ec057645266 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.041520 Apr 18 21:00:29 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 62/182] 10.0.0.210 () {66 vars in 1277 bytes} [Tue Apr 18 21:00:29 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:30 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:30 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] Creating event network-changed:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:00:30 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-de03ee9f-a1e5-45e8-9f65-89e6da5702a4 req-f4f45a1a-7e0c-4bdc-8060-536d342c086c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039957 Apr 18 21:00:30 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 60/183] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:31 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-649379328", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "a22cbca0-4451-45e1-8cdc-b8649f5dfe5d"}], "security_groups": [{"name": "tempest-securitygroup--1442657046"}], "key_name": "tempest-keypair-315105593", "user_data": "}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:31 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] validate_networks() for [('a22cbca0-4451-45e1-8cdc-b8649f5dfe5d', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Getting quotas for user 220589b8afc240778bff63d1e5ce20d1 and project 930dabaafe5c4d12ad95aa77bbc7cf5a. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:00:32 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:00:32 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-53db2e3a-a6fe-4ac7-85f2-59f260ed734f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.449722 Apr 18 21:00:32 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 62/184] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 21:00:31 2023] POST /compute/v2.1/servers => generated 400 bytes in 1451 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 21:00:32 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:32 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:32 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3deb0d7f-f532-4d52-9393-4c4353aacb78", "tag": "c5256384-64fb-4c26-a670-602a4ee1b12f"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:32 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:32 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:32 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:32 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] Creating event network-changed:c5256384-64fb-4c26-a670-602a4ee1b12f for instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 on user Apr 18 21:00:32 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-a0f23ea8-7783-49d9-8421-b8551fec1be0 req-401090b5-2013-459a-810e-49cbeb7a221d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Apr 18 21:00:32 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 61/185] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:32 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:32 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:32 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:32 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:32 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c224628a-0874-4ad6-b5b3-a09511503f5a tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 200 len: 1274 microversion: 2.20 time: 0.070188 Apr 18 21:00:32 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 63/186] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:00:32 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 1274 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:00:34 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "name": "network-vif-plugged", "status": "completed", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}, {"server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "name": "network-vif-plugged", "status": "completed", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:34 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:34 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Creating event network-vif-plugged:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:00:34 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] Creating event network-vif-plugged:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:00:34 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-1ea5a536-c57e-4797-8a6c-8f3dfa57284a req-921c38de-1629-4132-a3d4-aa03ac89a392 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031936 Apr 18 21:00:34 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 63/187] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:37 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3deb0d7f-f532-4d52-9393-4c4353aacb78", "name": "network-vif-deleted", "tag": "c5256384-64fb-4c26-a670-602a4ee1b12f"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:37 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:37 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:37 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:37 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.compute.server_external_events [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] Unable to find a host for instance 3deb0d7f-f532-4d52-9393-4c4353aacb78. Dropping event network-vif-deleted {{(pid=61134) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 21:00:37 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-f82fee6f-cfd4-497d-a444-d516dfb8291f req-017ce85d-d6c7-45bc-91da-46708d91f0df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030740 Apr 18 21:00:37 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 62/188] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:37 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=5 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:39 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:39 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] Creating event network-changed:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:00:39 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-bdd6e0cf-c62e-4fc3-ad05-9cf40fba371b req-e579036a-7379-4de9-bcb3-d6a55bfb4f8f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032484 Apr 18 21:00:39 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 64/189] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:40 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "name": "network-vif-plugged", "status": "completed", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:40 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:40 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:40 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:40 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] Creating event network-vif-plugged:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:00:40 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-8af0698b-84b0-4b0a-a8be-0270c219b0c7 req-9553fd25-25ad-4b18-aaab-5049754d1b07 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032705 Apr 18 21:00:40 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 64/190] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:42 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "name": "network-vif-plugged", "status": "completed", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:42 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:42 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:42 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:42 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:42 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] Creating event network-vif-plugged:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:00:42 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-655a6609-4a5d-4ba4-ae3f-6f97b5910604 req-40a6a01c-c296-4e93-888d-b91f4fdd282c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031641 Apr 18 21:00:42 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 63/191] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=12 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:46 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-7219927b-0a7f-46c8-aa1a-42dc9c5c85de tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.174094 Apr 18 21:00:46 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 65/192] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:00:45 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd/os-interface => generated 283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=12 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:47 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] Creating event network-changed:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 21:00:47 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-720897ff-538b-408e-a969-48da5ad8aff7 req-9a2029a1-1869-44fe-a6d9-e5e41cc328e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031713 Apr 18 21:00:47 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 65/193] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:00:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:47 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:47 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-7a90fa6d-8a88-41c5-b2b4-1415db2620f6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1538 microversion: 2.1 time: 0.516714 Apr 18 21:00:47 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 64/194] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:47 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1538 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:48 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:48 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-ec5ea453-57f5-4010-bb0c-eafe4680f65c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1538 microversion: 2.1 time: 0.215814 Apr 18 21:00:48 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 66/195] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:48 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1538 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] HTTP exception thrown: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Request method failure captured: Apr 18 21:00:50 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 HTTP/1.1 Apr 18 21:00:50 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:00:50 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:00:50 user devstack@n-api.service[61133]: Connection: close Apr 18 21:00:50 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:00:50 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:00:50 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:00:50 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:00:50 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRBIYIFol9wIEHeQ220tdyI1eKhc3Upd0b8jNFPI5KbN3sW1OIADW_nG4ebMLZEYETc2T_oUBn3pF9qRi6soCGmYSSHjY6fprjTR2S6J2awgdLUVovsR2h0JL3DjmuSUGqCi_xLxz3krpCUv21gD4DzPt3Xzf9nNPsuktaEHeeScbU Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Project-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92afe913f600401db1a67dbf41476e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Tenant-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:50 user devstack@n-api.service[61133]: X-User: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:50 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:00:50 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:00:50 user devstack@n-api.service[61133]: X-User-Id: f69c8b0336c84623b99e18a499be822d Apr 18 21:00:50 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:50 user devstack@n-api.service[61133]: method: > Apr 18 21:00:50 user devstack@n-api.service[61133]: exception: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:50 user devstack@n-api.service[61133]: action_args: {'id': '9e4bd7e5-d295-48a4-a218-77396df75c11'} Apr 18 21:00:50 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Returning 404 to user: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:00:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-27262d9c-a5bb-4e12-853e-71f45211ac12 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 404 len: 111 microversion: 2.1 time: 0.040350 Apr 18 21:00:50 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 66/196] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:50 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:00:50 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-f9eda608-c14d-4c63-b4ab-7e3fd7d8a6f2 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '.version_select at 0x7f51cffb96c0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:50 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-f9eda608-c14d-4c63-b4ab-7e3fd7d8a6f2 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254562589" status: 202 len: 0 microversion: 2.1 time: 0.037157 Apr 18 21:00:50 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 21:00:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254562589 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] HTTP exception thrown: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Request method failure captured: Apr 18 21:00:51 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 HTTP/1.1 Apr 18 21:00:51 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:00:51 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:00:51 user devstack@n-api.service[61135]: Connection: close Apr 18 21:00:51 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:00:51 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:00:51 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:00:51 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:00:51 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwRBIYIFol9wIEHeQ220tdyI1eKhc3Upd0b8jNFPI5KbN3sW1OIADW_nG4ebMLZEYETc2T_oUBn3pF9qRi6soCGmYSSHjY6fprjTR2S6J2awgdLUVovsR2h0JL3DjmuSUGqCi_xLxz3krpCUv21gD4DzPt3Xzf9nNPsuktaEHeeScbU Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Project-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92afe913f600401db1a67dbf41476e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Tenant-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61135]: X-User: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:51 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:00:51 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:00:51 user devstack@n-api.service[61135]: X-User-Id: f69c8b0336c84623b99e18a499be822d Apr 18 21:00:51 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:51 user devstack@n-api.service[61135]: method: > Apr 18 21:00:51 user devstack@n-api.service[61135]: exception: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61135]: action_args: {'id': '9e4bd7e5-d295-48a4-a218-77396df75c11'} Apr 18 21:00:51 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Returning 404 to user: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:00:51 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c8e1b4c3-2c34-4318-b5ee-7d938080a8bc tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 404 len: 111 microversion: 2.1 time: 0.031526 Apr 18 21:00:51 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 67/198] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:00:51 2023] DELETE /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] [instance: 9e4bd7e5-d295-48a4-a218-77396df75c11] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:51 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] HTTP exception thrown: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Request method failure captured: Apr 18 21:00:51 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 HTTP/1.1 Apr 18 21:00:51 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:00:51 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:00:51 user devstack@n-api.service[61133]: Connection: close Apr 18 21:00:51 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:00:51 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:00:51 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:00:51 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:00:51 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRBIYIFol9wIEHeQ220tdyI1eKhc3Upd0b8jNFPI5KbN3sW1OIADW_nG4ebMLZEYETc2T_oUBn3pF9qRi6soCGmYSSHjY6fprjTR2S6J2awgdLUVovsR2h0JL3DjmuSUGqCi_xLxz3krpCUv21gD4DzPt3Xzf9nNPsuktaEHeeScbU Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Project-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/92afe913f600401db1a67dbf41476e39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/92afe913f600401db1a67dbf41476e39"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Tenant-Id: 92afe913f600401db1a67dbf41476e39 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1388253824 Apr 18 21:00:51 user devstack@n-api.service[61133]: X-User: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:51 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:00:51 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:00:51 user devstack@n-api.service[61133]: X-User-Id: f69c8b0336c84623b99e18a499be822d Apr 18 21:00:51 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1388253824-project-member Apr 18 21:00:51 user devstack@n-api.service[61133]: method: > Apr 18 21:00:51 user devstack@n-api.service[61133]: exception: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61133]: action_args: {'id': '9e4bd7e5-d295-48a4-a218-77396df75c11'} Apr 18 21:00:51 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. Apr 18 21:00:51 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:00:51 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] Returning 404 to user: Instance 9e4bd7e5-d295-48a4-a218-77396df75c11 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:00:51 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-2948212d-351b-4485-9a2c-a8c783f5ca34 tempest-AttachSCSIVolumeTestJSON-1388253824 tempest-AttachSCSIVolumeTestJSON-1388253824-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11" status: 404 len: 111 microversion: 2.1 time: 0.026488 Apr 18 21:00:51 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 67/199] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:51 2023] GET /compute/v2.1/servers/9e4bd7e5-d295-48a4-a218-77396df75c11 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:00:53 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:00:53 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-89561cb2-791d-434a-b181-6d3e1d67118b tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68" status: 200 len: 1495 microversion: 2.1 time: 0.224848 Apr 18 21:00:53 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:00:53 2023] GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 => generated 1495 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=14 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:10 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:01:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:01:10 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b HTTP/1.1 Apr 18 21:01:10 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:01:10 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:01:10 user devstack@n-api.service[61135]: Connection: close Apr 18 21:01:10 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:01:10 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:01:10 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:01:10 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:01:10 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:01:10 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:01:11 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:01:11 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:01:11 user devstack@n-api.service[61135]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:01:11 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:01:11 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:01:11 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:01:11 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:01:11 user devstack@n-api.service[61135]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:01:11 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:01:11 user devstack@n-api.service[61135]: method: > Apr 18 21:01:11 user devstack@n-api.service[61135]: exception: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:01:11 user devstack@n-api.service[61135]: action_args: {'id': '12094087-b11e-4575-b6b3-09fb4091588b'} Apr 18 21:01:11 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:01:11 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:01:11 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:01:11 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-6dd3581a-fdf2-4b95-bda6-554cb42d57fe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 404 len: 111 microversion: 2.1 time: 0.035533 Apr 18 21:01:11 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 68/201] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:10 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:01:11 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4e08d154-305b-4509-9b69-495d1503e8bd tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '.version_select at 0x7f51d4f8b490>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:11 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:11 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=11 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:11 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-4e08d154-305b-4509-9b69-495d1503e8bd tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949563291" status: 202 len: 0 microversion: 2.1 time: 0.025171 Apr 18 21:01:11 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 68/202] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 21:01:11 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1949563291 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:01:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-f971f869-30a5-4029-92e0-8f1b576cfa03 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: .version_select at 0x7f51cffb92d0>, body: {"keypair": {"name": "tempest-keypair-986065476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQtgkkmdBCW4Im1S6OIVBs6EvnB7RoYMLtUhdA1+HNo849CLec1saof8UgYxUqrtAmFzGP2BFBjnuyh73ehnzhWNTebp7NaUZbxO9R6d8nPUcT+MBksn62A1yOOpf5u7A=="}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=19 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:11 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-f971f869-30a5-4029-92e0-8f1b576cfa03 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:01:11 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-f971f869-30a5-4029-92e0-8f1b576cfa03 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:01:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-f971f869-30a5-4029-92e0-8f1b576cfa03 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063440 Apr 18 21:01:11 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 67/203] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:01:11 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:13 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1883227807", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3b319de-2fa3-4858-b85a-891d6736ed6b"}], "security_groups": [{"name": "tempest-securitygroup--983037989"}], "key_name": "tempest-keypair-986065476", "user_data": "}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:13 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] validate_networks() for [('c3b319de-2fa3-4858-b85a-891d6736ed6b', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:01:14 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:01:14 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-fbd3485f-1ef9-4fac-8e4e-4b86ec5b213e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.704301 Apr 18 21:01:14 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 69/204] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:01:13 2023] POST /compute/v2.1/servers => generated 399 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:01:14 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-36c8b2b3-788b-4d13-8621-e2d6e18a735e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:14 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-36c8b2b3-788b-4d13-8621-e2d6e18a735e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:14 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-36c8b2b3-788b-4d13-8621-e2d6e18a735e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:14 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-36c8b2b3-788b-4d13-8621-e2d6e18a735e tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 200 len: 1235 microversion: 2.1 time: 0.088510 Apr 18 21:01:14 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 69/205] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:14 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 1235 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:16 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:16 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] Creating event network-changed:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:01:16 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-01894323-2aa4-47ec-b40d-f44dc6580fb8 req-5c37319d-1e7e-4191-b040-a47602c15c31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033108 Apr 18 21:01:16 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-a7eb7336-1dad-463b-838e-27d39c90fd20 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b" status: 200 len: 1503 microversion: 2.1 time: 0.235294 Apr 18 21:01:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 70/207] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:17 2023] GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.objects.instance [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lazy-loading 'fault' on Instance uuid 3deb0d7f-f532-4d52-9393-4c4353aacb78 {{(pid=61134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6e3e25f5-32a9-4334-ae64-fe4b6a678a59 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78" status: 200 len: 1649 microversion: 2.87 time: 0.336275 Apr 18 21:01:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 69/208] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:01:18 2023] GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78 => generated 1649 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Doing local delete in cell 88560d0d-7818-4020-888f-ef6d4621691d(cell1) {{(pid=61135) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:18 user devstack@n-api.service[61135]: WARNING nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] instance's host None is down, deleting from database Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] deallocate_for_instance() {{(pid=61135) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Instance cache missing network info. {{(pid=61135) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 21:01:18 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Updating instance_info_cache with network_info: [] {{(pid=61135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 21:01:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-825a844d-d9e9-4ef9-ac33-b4ea65e92dc5 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1494 microversion: 2.1 time: 0.832612 Apr 18 21:01:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 70/209] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:18 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1494 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61135) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 21:01:18 user devstack@n-api.service[61135]: WARNING nova.compute.api [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] Creating event network-vif-plugged:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:01:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-9719cf46-2f2e-4c62-b75a-4f8410c9052b req-1e950db1-0fde-4a19-88e9-411b37c32f79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035692 Apr 18 21:01:19 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 70/210] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:19 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-45503f35-977f-4175-a60a-5d4326946eec tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78" status: 204 len: 0 microversion: 2.87 time: 0.602928 Apr 18 21:01:19 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 71/211] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:01:18 2023] DELETE /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3deb0d7f-f532-4d52-9393-4c4353aacb78] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:19 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] HTTP exception thrown: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Request method failure captured: Apr 18 21:01:19 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78 HTTP/1.1 Apr 18 21:01:19 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:01:19 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:01:19 user devstack@n-api.service[61133]: Connection: close Apr 18 21:01:19 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:01:19 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:01:19 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:01:19 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:01:19 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQ2GLaTqnh_NdRKUw7KdgEdHFqYOFul2s74Z_3a1P0_egczQhVglCD-LeSSmDOSdMPkT5_t4rdPTfZHwA5TI8Uyb6Mpx_IaArkfq3r63Tkmi3WM1QoXGBaY_g2xpbtaThdbwDT4Vr6J4WXXFCf5y5c8yurEW9pgsDjpF0xknKN4dkw Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Project-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Tenant-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:01:19 user devstack@n-api.service[61133]: X-User: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:01:19 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:01:19 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:01:19 user devstack@n-api.service[61133]: X-User-Id: e6caad8bd6fe44b6ab8868167473d4fe Apr 18 21:01:19 user devstack@n-api.service[61133]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:01:19 user devstack@n-api.service[61133]: method: > Apr 18 21:01:19 user devstack@n-api.service[61133]: exception: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. Apr 18 21:01:19 user devstack@n-api.service[61133]: action_args: {'id': '3deb0d7f-f532-4d52-9393-4c4353aacb78'} Apr 18 21:01:19 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. Apr 18 21:01:19 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:01:19 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Returning 404 to user: Instance 3deb0d7f-f532-4d52-9393-4c4353aacb78 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:01:19 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0b7ccb71-30f5-4585-9bc6-a819207cbd4b tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78" status: 404 len: 111 microversion: 2.87 time: 0.067458 Apr 18 21:01:19 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 71/212] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:01:19 2023] GET /compute/v2.1/servers/3deb0d7f-f532-4d52-9393-4c4353aacb78 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:01:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-808917023", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "2a459fb0-36eb-4c75-afd7-0de7482741f7"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:19 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] validate_networks() for [('2a459fb0-36eb-4c75-afd7-0de7482741f7', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for user e6caad8bd6fe44b6ab8868167473d4fe and project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:01:20 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:01:20 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-be2c06d6-0c47-4c0f-aed5-f34df58c2eb3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.568765 Apr 18 21:01:20 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 71/213] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 21:01:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 21:01:20 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:20 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:20 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:20 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:20 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:20 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c0df5964-835e-43f6-8ced-f374c143d10e tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 200 len: 1394 microversion: 2.87 time: 0.083310 Apr 18 21:01:20 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 72/214] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:01:20 2023] GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 1394 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:01:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] Creating event network-vif-plugged:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:01:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-37ea513d-0b87-464d-9d1d-684011cb755d req-4ad31823-84ff-4693-9203-0fe2bdaa899a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Apr 18 21:01:21 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 72/215] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 21:01:22 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:22 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:23 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] Creating event network-changed:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:01:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-a4927882-5dbd-49ff-bb0c-acfbd6f181ac req-23001e84-b21d-4324-9d2c-f12fc771cd72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030396 Apr 18 21:01:23 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 73/216] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:23 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-81a668b3-a104-4cf5-816a-63b4bc52de25 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 200 len: 1586 microversion: 2.20 time: 0.479533 Apr 18 21:01:23 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 72/217] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:01:22 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 1586 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:01:25 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "name": "network-vif-plugged", "status": "completed", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:25 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] Creating event network-vif-plugged:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:01:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-97b5a9a1-b3ef-4219-adf0-2d271fae52cb req-d52f5caa-276b-4256-81ff-6c3a0c02b9c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034248 Apr 18 21:01:25 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 73/218] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:27 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:27 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "name": "network-vif-plugged", "status": "completed", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] Creating event network-vif-plugged:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:01:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-2addc7c2-2e7e-40fb-a44c-c79a41f1feb6 req-021f1f0b-4277-405c-8aac-4003b82c2726 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041917 Apr 18 21:01:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 74/219] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:28 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:29 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9856fa4dcb9d407bbeb0952587500917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f30bf556984db19a19b918133d0ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:29 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-37ca4720-1b09-460d-8e70-bd85febd80f6 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 200 len: 1671 microversion: 2.1 time: 0.278732 Apr 18 21:01:29 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:28 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 1671 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:30 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-5b85a593-9601-419f-85b6-b10235505cd3 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '.version_select at 0x7f51d42f8040>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-5b85a593-9601-419f-85b6-b10235505cd3 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c" status: 204 len: 0 microversion: 2.1 time: 0.264558 Apr 18 21:01:31 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 74/221] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:30 2023] DELETE /compute/v2.1/images/484aebc1-ec99-4bb3-ab97-400f4649554c => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=8 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:31 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:01:31 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e2c7829d-cf49-4690-becf-ddf74fb05b01 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 204 len: 0 microversion: 2.1 time: 0.166448 Apr 18 21:01:31 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 75/222] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:01:31 2023] DELETE /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=10 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:31 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9856fa4dcb9d407bbeb0952587500917', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f7f30bf556984db19a19b918133d0ade', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:31 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-31af071a-dc6c-4eae-8b50-332c8ef02e12 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 200 len: 1677 microversion: 2.1 time: 0.166600 Apr 18 21:01:31 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:31 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:31 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "name": "network-vif-unplugged", "status": "completed", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] Creating event network-vif-unplugged:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 21:01:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-09984b29-4252-4307-aaaf-440114a9d774 req-170503fe-acd3-4f28-ad4d-4d13f5045ca8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032285 Apr 18 21:01:31 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 75/224] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 21:01:33 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "name": "network-vif-plugged", "status": "completed", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}, {"server_uuid": "cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2", "name": "network-vif-deleted", "tag": "33329926-393f-4b4b-80c1-5b5d97bdfc2d"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Creating event network-vif-plugged:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 21:01:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] Creating event network-vif-deleted:33329926-393f-4b4b-80c1-5b5d97bdfc2d for instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 on user Apr 18 21:01:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-9641a70a-9b43-4a03-93f0-9b91b08c9b2b req-5d9069fc-2e0d-4973-9a2f-b10019371d39 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032434 Apr 18 21:01:33 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 76/225] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:33 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:38 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:38 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-86dfce05-3c52-4462-9be5-fa4d0c23f7a1 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.220466 Apr 18 21:01:38 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:38 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:38 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-9fd48c9e-180e-466e-b959-c0a8fff8b22c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.166579 Apr 18 21:01:38 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 76/227] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:38 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=19,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:55 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:01:55 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-50547e75-28b9-43a0-9c47-3b48f8b6fc1a tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68" status: 204 len: 0 microversion: 2.1 time: 0.136506 Apr 18 21:01:55 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 77/228] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:01:55 2023] DELETE /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=38 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:55 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:01:55 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-df54db57-2409-46fe-9cbb-3454929b9e41 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68" status: 200 len: 1501 microversion: 2.1 time: 0.258899 Apr 18 21:01:55 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 76/229] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:01:55 2023] GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 => generated 1501 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "name": "network-vif-unplugged", "status": "completed", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=20 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:55 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:55 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] Creating event network-vif-unplugged:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:01:55 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-b3698b32-95e7-4b09-b4ea-c61d438b7070 req-42197718-ac75-4ec8-babb-2465d59ca08c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046706 Apr 18 21:01:55 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 77/230] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:56 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "name": "network-vif-deleted", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:56 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] Creating event network-vif-deleted:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:01:56 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-4f9d210f-1ac0-4f02-9ce0-4b32e2d5f3c6 req-31eb3c08-3188-4a4b-8518-33e0bd1abf91 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033212 Apr 18 21:01:56 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 78/231] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:01:57 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75507028-ae5f-4d84-8a8a-2b767254ea68", "name": "network-vif-plugged", "status": "completed", "tag": "4ec564b6-d550-4e57-9796-6ce172b42ab7"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:01:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:01:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:01:57 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:01:57 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] Creating event network-vif-plugged:4ec564b6-d550-4e57-9796-6ce172b42ab7 for instance 75507028-ae5f-4d84-8a8a-2b767254ea68 on user Apr 18 21:01:57 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-80939d9c-694e-441b-8336-694d040e13f5 req-7fe50640-cff8-4208-ac41-3f85ca697eab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028649 Apr 18 21:01:57 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 77/232] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:01:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:04 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:04 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-e981a3c4-9670-4277-a77c-6c38261da775 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 200 len: 1545 microversion: 2.1 time: 0.267047 Apr 18 21:02:04 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 78/233] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:04 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 1545 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:10 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:10 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-a8ba466f-f3c0-4132-a918-3427ff18c3a3 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 200 len: 1691 microversion: 2.87 time: 0.295600 Apr 18 21:02:10 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 79/234] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:02:10 2023] GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 1691 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=8 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1043548178", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "510b5b0f-6710-4d7a-a4fd-24afdc62981e"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] validate_networks() for [('510b5b0f-6710-4d7a-a4fd-24afdc62981e', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Getting quotas for project e102abbb675645edbbd042f775e89e50. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Getting quotas for user b36a393d92e948b1ada87c4823d14bee and project e102abbb675645edbbd042f775e89e50. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:02:19 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:02:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6a069cdc-9790-4eeb-857d-db7669314992 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.790431 Apr 18 21:02:19 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 78/235] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:02:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:02:19 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4fbc745f-2e7e-4e63-9355-20276a2759cd tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:19 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-4fbc745f-2e7e-4e63-9355-20276a2759cd tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:19 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:19 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=8 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:20 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-4fbc745f-2e7e-4e63-9355-20276a2759cd tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:20 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-4fbc745f-2e7e-4e63-9355-20276a2759cd tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 200 len: 1211 microversion: 2.1 time: 0.189870 Apr 18 21:02:20 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 79/236] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:19 2023] GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=4 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:02:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-35b7bf92-d5f9-47a3-8727-55bc6f9073b3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 204 len: 0 microversion: 2.1 time: 0.114909 Apr 18 21:02:21 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 80/237] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:02:21 2023] DELETE /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-unplugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] [instance: cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] Creating event network-vif-unplugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-081a29f7-3fe2-4bea-9d8b-62721b07fd8f req-6685c8d9-d9c3-4201-b84e-56e65fd0f812 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029509 Apr 18 21:02:21 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 80/238] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] HTTP exception thrown: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Request method failure captured: Apr 18 21:02:21 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 HTTP/1.1 Apr 18 21:02:21 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:02:21 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:02:21 user devstack@n-api.service[61135]: Connection: close Apr 18 21:02:21 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:02:21 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:02:21 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:02:21 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:02:21 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQ-NvZSLceWwdumzF_3yVsi7D18HwQq2HuG_XE_dcJM_oeJ2kX36PsWX6QQDGmhdhAyz_2zXjx55FsyDKpMc_vjVn1uV6Zg0dMusdNvFDymTSGvpM-l7EsFdnbgvfbBSHFqWACcXTiigDQdgxXehH9b-1Nb9OnRTl5x2W1AlAL_sUQ Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Project-Id: f7f30bf556984db19a19b918133d0ade Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1995300126 Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7f30bf556984db19a19b918133d0ade"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f7f30bf556984db19a19b918133d0ade"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f7f30bf556984db19a19b918133d0ade"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Tenant: tempest-ServerStableDeviceRescueTest-1995300126 Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Tenant-Id: f7f30bf556984db19a19b918133d0ade Apr 18 21:02:21 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1995300126 Apr 18 21:02:21 user devstack@n-api.service[61135]: X-User: tempest-ServerStableDeviceRescueTest-1995300126-project-member Apr 18 21:02:21 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:02:21 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:02:21 user devstack@n-api.service[61135]: X-User-Id: 9856fa4dcb9d407bbeb0952587500917 Apr 18 21:02:21 user devstack@n-api.service[61135]: X-User-Name: tempest-ServerStableDeviceRescueTest-1995300126-project-member Apr 18 21:02:21 user devstack@n-api.service[61135]: method: > Apr 18 21:02:21 user devstack@n-api.service[61135]: exception: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. Apr 18 21:02:21 user devstack@n-api.service[61135]: action_args: {'id': 'cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2'} Apr 18 21:02:21 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. Apr 18 21:02:21 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:02:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Returning 404 to user: Instance cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:02:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-f0833315-dd49-46b5-8482-afc2829cbe1e tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2" status: 404 len: 111 microversion: 2.1 time: 0.039918 Apr 18 21:02:21 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 81/239] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:21 2023] GET /compute/v2.1/servers/cfa0b54d-3e6e-40a6-b5f5-f7af22b8e6e2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:02:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6a52aeb4-54f4-44f0-af49-f3ac51bb51e4 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] Calling method '.version_select at 0x7f51d42fa3b0>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-6a52aeb4-54f4-44f0-af49-f3ac51bb51e4 tempest-ServerStableDeviceRescueTest-1995300126 tempest-ServerStableDeviceRescueTest-1995300126-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280229981" status: 202 len: 0 microversion: 2.1 time: 0.021165 Apr 18 21:02:21 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 81/240] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 21:02:21 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280229981 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:02:21 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:21 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-baef16cf-36d0-4e38-89d5-8aaf6824fa36 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 200 len: 1496 microversion: 2.1 time: 0.402699 Apr 18 21:02:21 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 79/241] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:21 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 1496 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:02:22 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:22 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] Creating event network-changed:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:02:22 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-b03cadf8-1929-497d-82a6-5ee229aaee21 req-3322c3a8-3f28-498a-a271-68681386c871 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029389 Apr 18 21:02:22 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 82/242] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:23 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:23 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-plugged", "status": "completed", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] Creating event network-vif-plugged:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 21:02:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-a3876803-9679-4e0b-a676-17bdc5c72aaa req-c383a5cd-2cc4-4d18-9b74-f2ee73e87622 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028526 Apr 18 21:02:23 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 80/243] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:24 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-f5772205-48fe-4321-8dc2-7b39c9ad3e88 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.740085 Apr 18 21:02:24 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 82/244] 10.0.0.210 () {64 vars in 1393 bytes} [Tue Apr 18 21:02:23 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb/os-interface => generated 282 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 21:02:24 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41cadb33-a43a-4098-b21a-42901102779f", "name": "network-vif-deleted", "tag": "4f4ab299-bd2d-4ec1-adde-ba215ea14907"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:24 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] Creating event network-vif-deleted:4f4ab299-bd2d-4ec1-adde-ba215ea14907 for instance 41cadb33-a43a-4098-b21a-42901102779f on user Apr 18 21:02:24 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-390cd42a-c36b-4e61-a5d6-de2c5453cd3b req-e4bf5852-d0e0-48ee-8854-446ba8ca8613 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043168 Apr 18 21:02:24 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 83/245] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-3f791dde-6e0b-4a6c-a8e3-e1c2f94d1586 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb/ips" status: 200 len: 110 microversion: 2.20 time: 0.037702 Apr 18 21:02:25 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 81/246] 10.0.0.210 () {64 vars in 1366 bytes} [Tue Apr 18 21:02:25 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb/ips => generated 110 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 18 21:02:25 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "name": "network-vif-plugged", "status": "completed", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}, {"name": "network-changed", "server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}, {"server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "name": "network-vif-plugged", "status": "completed", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Creating event network-vif-plugged:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:02:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Creating event network-changed:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:02:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] Creating event network-vif-plugged:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:02:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-444f4176-a6fa-491c-afdc-7e92fe67a393 req-ca30da4d-3419-4d56-b657-563e97cb7a0e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.038753 Apr 18 21:02:25 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 83/247] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:25 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:26 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:02:26 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-7ee30957-1c4b-4a48-b83c-95272ec234a6 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 204 len: 0 microversion: 2.20 time: 0.112319 Apr 18 21:02:26 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 84/248] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:02:26 2023] DELETE /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:26 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:27 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:27 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:27 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '220589b8afc240778bff63d1e5ce20d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '930dabaafe5c4d12ad95aa77bbc7cf5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:27 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-2b241b3a-69d5-471b-ba74-2ba8edaa6932 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 200 len: 1711 microversion: 2.20 time: 0.191621 Apr 18 21:02:27 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 82/249] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:02:26 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 1711 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:02:27 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "name": "network-vif-unplugged", "status": "completed", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}, {"server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "name": "network-vif-plugged", "status": "completed", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:27 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:27 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Creating event network-vif-unplugged:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:02:27 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] Creating event network-vif-plugged:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:02:27 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-b9b7f9aa-6b6f-4cad-9bd2-c21d1b707dff req-a3ffa30f-414d-43dc-aeb7-c66c58321692 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.046633 Apr 18 21:02:27 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 84/250] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:27 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:28 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927090e3-caa4-446f-86d7-69410977a5cb", "name": "network-vif-deleted", "tag": "53a84c09-289e-4521-b8b4-b203da47a647"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:28 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:28 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] Creating event network-vif-deleted:53a84c09-289e-4521-b8b4-b203da47a647 for instance 927090e3-caa4-446f-86d7-69410977a5cb on user Apr 18 21:02:28 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-fdb716c0-c238-4311-9d55-1db426e7f8c5 req-fca52ca6-887f-420b-a88e-b8f3f6f09995 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033772 Apr 18 21:02:28 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 85/251] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=20 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:40 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:40 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-51575a9d-0335-4ea0-b2f1-4f667df29f44 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.329901 Apr 18 21:02:40 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 83/252] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:40 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 75507028-ae5f-4d84-8a8a-2b767254ea68] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] HTTP exception thrown: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Request method failure captured: Apr 18 21:02:45 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 HTTP/1.1 Apr 18 21:02:45 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:02:45 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:02:45 user devstack@n-api.service[61133]: Connection: close Apr 18 21:02:45 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:02:45 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:02:45 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:02:45 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:02:45 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRCmgGz1_WA3txNZIn0vTDTnhc7eoyjg9FVadkA8Sjet2MheWN3-sGZgUehtvqyNK3cWSI0JE2WZxf1wIYjby4roDl6EkwTPRLD7JRidZdadoSOn7mfE82M9tPprjtbjIeCyIOwVNsFBG4m7y1wn-CE8k_RLlnwRyDrrNBpuvzp13c Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Project-Id: cc1123ea88c041ed82b64c982aac6a35 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Project-Name: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Tenant: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Tenant-Id: cc1123ea88c041ed82b64c982aac6a35 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-User: tempest-VolumesAdminNegativeTest-168114348-project-member Apr 18 21:02:45 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:02:45 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:02:45 user devstack@n-api.service[61133]: X-User-Id: e4224e9c1f5a47649dae0fd569edace2 Apr 18 21:02:45 user devstack@n-api.service[61133]: X-User-Name: tempest-VolumesAdminNegativeTest-168114348-project-member Apr 18 21:02:45 user devstack@n-api.service[61133]: method: > Apr 18 21:02:45 user devstack@n-api.service[61133]: exception: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. Apr 18 21:02:45 user devstack@n-api.service[61133]: action_args: {'id': '75507028-ae5f-4d84-8a8a-2b767254ea68'} Apr 18 21:02:45 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. Apr 18 21:02:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:02:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Returning 404 to user: Instance 75507028-ae5f-4d84-8a8a-2b767254ea68 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:02:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-fae0fabf-24d8-4a57-abd7-4387e1050360 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68" status: 404 len: 111 microversion: 2.1 time: 0.049598 Apr 18 21:02:45 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 85/253] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:45 2023] GET /compute/v2.1/servers/75507028-ae5f-4d84-8a8a-2b767254ea68 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:46 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:02:46 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c7809dfb-d0f4-4648-b355-038ab45f4295 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710" status: 204 len: 0 microversion: 2.1 time: 0.118102 Apr 18 21:02:46 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 86/254] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:02:45 2023] DELETE /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:46 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4224e9c1f5a47649dae0fd569edace2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc1123ea88c041ed82b64c982aac6a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:02:46 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-fc270cbc-757b-49ec-988e-542957a9c703 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710" status: 200 len: 1671 microversion: 2.1 time: 0.240512 Apr 18 21:02:46 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 84/255] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:02:46 2023] GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 => generated 1671 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:02:47 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "name": "network-vif-unplugged", "status": "completed", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:47 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:47 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] Creating event network-vif-unplugged:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 21:02:47 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-8f087a9e-4a9e-41ff-ab40-9ada44e60072 req-f690b415-ae3e-47be-8337-a265e37abe6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086096 Apr 18 21:02:47 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 86/256] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:48 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "name": "network-vif-deleted", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:48 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:48 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] Creating event network-vif-deleted:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 21:02:48 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-004ca9da-6dca-4671-bb78-bea1c41d6a20 req-f7f78fbe-e4f9-4661-be5d-77cde21a6ffd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.216935 Apr 18 21:02:48 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 87/257] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:49 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0de111c2-401c-497d-9f87-af914cc14710", "name": "network-vif-plugged", "status": "completed", "tag": "abba5e0f-85e5-43d4-9aa8-6070e80d93ff"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:02:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:02:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:02:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] Creating event network-vif-plugged:abba5e0f-85e5-43d4-9aa8-6070e80d93ff for instance 0de111c2-401c-497d-9f87-af914cc14710 on user Apr 18 21:02:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-4d4eec57-4861-43bf-9c84-6441f08c568e req-18336ce1-8de0-4b92-8812-2344be34915e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030171 Apr 18 21:02:49 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 85/258] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:02:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:54 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4bfae5b7-3ab8-4fcb-82c5-fc031d469d84 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] Action: 'create', calling method: .version_select at 0x7f51d42f8ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1532410493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpbHXdl6GSJItbd/+L3t6EH6+LOJHYdhloS3K1s9Od7u57yAKf7js9ToT85JnmtsEJwUP33jw51dQfDnBPfwMq3CLz6WOWm+Kgo3/mNxUrFl1jMdu4+1PIQ2z6Mg0sMwg=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:02:54 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-4bfae5b7-3ab8-4fcb-82c5-fc031d469d84 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] Getting quotas for project 0160c1d55d624c76812294db251b9a07. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:02:54 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-4bfae5b7-3ab8-4fcb-82c5-fc031d469d84 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] Getting quotas for user d1bebdc54f8447d7940e67d92d9d90a3 and project 0160c1d55d624c76812294db251b9a07. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:02:54 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-4bfae5b7-3ab8-4fcb-82c5-fc031d469d84 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.153426 Apr 18 21:02:54 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 87/259] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:02:54 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:02:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-ecef4c21-867c-40c0-9667-bee747a3dda7 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] Calling method '.version_select at 0x7f51cfe5ca60>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:02:57 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-ecef4c21-867c-40c0-9667-bee747a3dda7 tempest-TestShelveInstance-11921144 tempest-TestShelveInstance-11921144-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532410493" status: 202 len: 0 microversion: 2.1 time: 0.022894 Apr 18 21:02:57 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 88/260] 10.0.0.210 () {62 vars in 1331 bytes} [Tue Apr 18 21:02:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1532410493 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=14 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-3291e7c0-7380-44a7-852f-01af86f67ee7 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.182323 Apr 18 21:03:04 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 86/261] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:03:04 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45/os-interface => generated 283 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:05 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:05 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] Creating event network-changed:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:03:05 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-70875048-d737-4253-8d3d-306bfcb99807 req-c8039b74-4e9c-4c05-b9f3-c48d62f55326 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035468 Apr 18 21:03:05 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 88/262] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:05 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:05 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-bce9bfb5-e0d4-4d13-a130-d6e570474f7f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45/ips" status: 200 len: 109 microversion: 2.1 time: 0.043688 Apr 18 21:03:05 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 89/263] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:03:05 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45/ips => generated 109 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:07 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:03:07 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-37bd5519-ce0d-4b64-8dc7-4af35851dbc2 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 204 len: 0 microversion: 2.1 time: 0.121303 Apr 18 21:03:07 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 87/264] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:03:07 2023] DELETE /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:07 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:07 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-57311e2c-6070-4416-896a-2eaf5f51f6a0 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 200 len: 1669 microversion: 2.1 time: 0.216991 Apr 18 21:03:07 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 89/265] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:07 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 1669 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:07 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "name": "network-vif-unplugged", "status": "completed", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}, {"server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "name": "network-vif-plugged", "status": "completed", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:07 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:07 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:07 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:07 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Creating event network-vif-unplugged:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:03:07 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] Creating event network-vif-plugged:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:03:07 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-05edfea0-44a1-4309-8d6c-01e11d5d337d req-de1f9144-6f34-4516-aaa9-5bee548b0f4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032282 Apr 18 21:03:07 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 90/266] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:07 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:09 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a81d8561-aac4-4087-9c97-6180a3fbfc45", "name": "network-vif-deleted", "tag": "b9ae6aa1-a863-41af-a249-24059bd82ffc"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:09 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] Creating event network-vif-deleted:b9ae6aa1-a863-41af-a249-24059bd82ffc for instance a81d8561-aac4-4087-9c97-6180a3fbfc45 on user Apr 18 21:03:09 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-48c7aa1c-d53a-4145-9158-bafb0790ceaa req-8b7d388a-405d-47c0-813f-95a24592d74b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049715 Apr 18 21:03:09 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 88/267] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:10 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-304c7890-9440-4f17-a689-7792aafe399b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 200 len: 1494 microversion: 2.1 time: 0.225734 Apr 18 21:03:10 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 90/268] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:10 2023] GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 1494 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-2145262652"}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: 41cadb33-a43a-4098-b21a-42901102779f] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] HTTP exception thrown: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Request method failure captured: Apr 18 21:03:11 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f HTTP/1.1 Apr 18 21:03:11 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:03:11 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:03:11 user devstack@n-api.service[61134]: Connection: close Apr 18 21:03:11 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:03:11 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:03:11 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:03:11 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:03:11 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQ70UPSfi6ggO6lPth71k6h8i47p6yDbFRkKZ4hrVqYnqCWHNGcGb7KCZeP2dShQkkT0w4iOHzWIGTTfVcckuLYCVg7IYLxF3JgLfDq6mPL25FzZyoQoBTrb2VK1wHU_k9Hrs3EQGXiQY8DhUIp6ifxMrLaRtxRp5QNE7HFk5V7aZQ Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Project-Id: ef80599ace4b477c9a9222526789e3c6 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Tenant-Id: ef80599ace4b477c9a9222526789e3c6 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-User: tempest-ServerRescueNegativeTestJSON-1697925108-project-member Apr 18 21:03:11 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:03:11 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:03:11 user devstack@n-api.service[61134]: X-User-Id: 790ad228383143da97ce2b964b7fce07 Apr 18 21:03:11 user devstack@n-api.service[61134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1697925108-project-member Apr 18 21:03:11 user devstack@n-api.service[61134]: method: > Apr 18 21:03:11 user devstack@n-api.service[61134]: exception: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. Apr 18 21:03:11 user devstack@n-api.service[61134]: action_args: {'id': '41cadb33-a43a-4098-b21a-42901102779f'} Apr 18 21:03:11 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. Apr 18 21:03:11 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Returning 404 to user: Instance 41cadb33-a43a-4098-b21a-42901102779f could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-259c97da-e380-4049-a68b-14578ed8f1fc tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f" status: 404 len: 111 microversion: 2.1 time: 0.130244 Apr 18 21:03:11 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 89/269] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:11 2023] GET /compute/v2.1/servers/41cadb33-a43a-4098-b21a-42901102779f => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:11 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:03:11 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d09d75dd-32c0-432c-8578-43fd81d8b3c6 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1/action" status: 202 len: 52 microversion: 2.87 time: 1.345051 Apr 18 21:03:11 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 91/270] 10.0.0.210 () {66 vars in 1396 bytes} [Tue Apr 18 21:03:10 2023] POST /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1/action => generated 52 bytes in 1347 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 18 21:03:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-2d81b951-cb7e-4b5e-9ceb-279529874410 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b" status: 204 len: 0 microversion: 2.1 time: 0.108485 Apr 18 21:03:12 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 91/271] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:03:11 2023] DELETE /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:12 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '790ad228383143da97ce2b964b7fce07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef80599ace4b477c9a9222526789e3c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:12 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6aaa67e7-425d-49a9-b5e4-4ff1bf1b8bc3 tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b" status: 200 len: 1509 microversion: 2.1 time: 0.253152 Apr 18 21:03:12 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 90/272] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:12 2023] GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:12 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "name": "network-vif-unplugged", "status": "completed", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:12 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] Creating event network-vif-unplugged:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 21:03:12 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-b755706c-b143-42e7-8a36-b5de4a0b2ff3 req-81cee533-b702-4433-a8b9-0afeb4a85b47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118746 Apr 18 21:03:12 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 92/273] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 21:03:13 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "name": "network-vif-deleted", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] Creating event network-vif-deleted:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 21:03:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-20a5f8d5-667f-42a1-940b-a7e15e3d1fce req-31d5a664-5ed5-4ab0-9c6c-6026ace83c8a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028974 Apr 18 21:03:13 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 92/274] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afb0cff7-4b43-44b4-899e-90070124db3b", "name": "network-vif-plugged", "status": "completed", "tag": "639017d5-e51a-492b-8418-1128b9260a0e"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] Creating event network-vif-plugged:639017d5-e51a-492b-8418-1128b9260a0e for instance afb0cff7-4b43-44b4-899e-90070124db3b on user Apr 18 21:03:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-68a00f76-f343-4138-8d9c-913f045ae360 req-1613de55-af04-48c5-8120-a642813c1f0f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086804 Apr 18 21:03:14 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 91/275] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:17 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:03:17 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb HTTP/1.1 Apr 18 21:03:17 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:03:17 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:03:17 user devstack@n-api.service[61135]: Connection: close Apr 18 21:03:17 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:03:17 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:03:17 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:03:17 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:03:17 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:17 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:17 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:03:17 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:03:17 user devstack@n-api.service[61135]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:03:17 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:17 user devstack@n-api.service[61135]: method: > Apr 18 21:03:17 user devstack@n-api.service[61135]: exception: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:17 user devstack@n-api.service[61135]: action_args: {'id': '927090e3-caa4-446f-86d7-69410977a5cb'} Apr 18 21:03:17 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:17 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:17 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d04daa0f-366e-40bf-82eb-1c849daf54d1 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 404 len: 111 microversion: 2.20 time: 0.134749 Apr 18 21:03:17 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 93/276] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:03:17 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-891143ee-57cf-40f9-85f8-cdb05e9f7bd9 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '.version_select at 0x7f51cffbab90>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:17 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-891143ee-57cf-40f9-85f8-cdb05e9f7bd9 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-315105593" status: 204 len: 0 microversion: 2.20 time: 0.021027 Apr 18 21:03:17 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 92/277] 10.0.0.210 () {64 vars in 1336 bytes} [Tue Apr 18 21:03:17 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-315105593 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:17 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:17 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-aba40c48-0917-4a30-9040-f6efddf2847d tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 200 len: 1691 microversion: 2.87 time: 0.246465 Apr 18 21:03:17 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 93/278] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:03:17 2023] GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 1691 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:03:18 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb HTTP/1.1 Apr 18 21:03:18 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:03:18 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:03:18 user devstack@n-api.service[61135]: Connection: close Apr 18 21:03:18 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:03:18 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:03:18 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:03:18 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:03:18 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61135]: method: > Apr 18 21:03:18 user devstack@n-api.service[61135]: exception: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: action_args: {'id': '927090e3-caa4-446f-86d7-69410977a5cb'} Apr 18 21:03:18 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-83ff3e3c-af45-4d38-aa67-3b968d877bde tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 404 len: 111 microversion: 2.20 time: 0.034485 Apr 18 21:03:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 94/279] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:03:18 2023] DELETE /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 927090e3-caa4-446f-86d7-69410977a5cb] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:03:18 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb HTTP/1.1 Apr 18 21:03:18 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:03:18 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:03:18 user devstack@n-api.service[61134]: Connection: close Apr 18 21:03:18 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:03:18 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:03:18 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:03:18 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:03:18 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61134]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:03:18 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61134]: method: > Apr 18 21:03:18 user devstack@n-api.service[61134]: exception: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61134]: action_args: {'id': '927090e3-caa4-446f-86d7-69410977a5cb'} Apr 18 21:03:18 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. Apr 18 21:03:18 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 927090e3-caa4-446f-86d7-69410977a5cb could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-1e5997fe-9a7c-425b-b50e-70a80d1c87f8 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb" status: 404 len: 111 microversion: 2.20 time: 0.026779 Apr 18 21:03:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 93/280] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:03:18 2023] GET /compute/v2.1/servers/927090e3-caa4-446f-86d7-69410977a5cb => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:03:18 user devstack@n-api.service[61133]: request: DELETE /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 HTTP/1.1 Apr 18 21:03:18 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:03:18 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:03:18 user devstack@n-api.service[61133]: Connection: close Apr 18 21:03:18 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:03:18 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:03:18 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:03:18 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:03:18 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61133]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:03:18 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61133]: method: > Apr 18 21:03:18 user devstack@n-api.service[61133]: exception: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61133]: action_args: {'id': '8b9d151c-45d7-4172-ace6-65d16d94ae56'} Apr 18 21:03:18 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:18 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-e5719706-5b0e-4422-945d-1c665effc2a7 tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 404 len: 111 microversion: 2.20 time: 0.026209 Apr 18 21:03:18 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 94/281] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:03:18 2023] DELETE /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] [instance: 8b9d151c-45d7-4172-ace6-65d16d94ae56] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] HTTP exception thrown: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Request method failure captured: Apr 18 21:03:18 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 HTTP/1.1 Apr 18 21:03:18 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:03:18 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:03:18 user devstack@n-api.service[61135]: Connection: close Apr 18 21:03:18 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:03:18 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:03:18 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:03:18 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:03:18 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQ9FG518ZIbHT2dLsp0pRRlC-9VWjlTLVek7UGw91bl_BE-W_gp8ZoTasCTdY_6R5Okv1p-2GrCgaFJosCryvDCUZCRw1bWHHqF75g-f3qrdSjVnKAD1Dzb2JmOU6XsaZ0lPZnYL9RTVoNi8hwYQZDTcGZRbr7r2Vdd1_ZZ16hsx2Q Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Openstack-Nova-Api-Version: 2.20 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/930dabaafe5c4d12ad95aa77bbc7cf5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant-Id: 930dabaafe5c4d12ad95aa77bbc7cf5a Apr 18 21:03:18 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-119116216 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Id: 220589b8afc240778bff63d1e5ce20d1 Apr 18 21:03:18 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeShelveTestJSON-119116216-project-member Apr 18 21:03:18 user devstack@n-api.service[61135]: method: > Apr 18 21:03:18 user devstack@n-api.service[61135]: exception: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: action_args: {'id': '8b9d151c-45d7-4172-ace6-65d16d94ae56'} Apr 18 21:03:18 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. Apr 18 21:03:18 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] Returning 404 to user: Instance 8b9d151c-45d7-4172-ace6-65d16d94ae56 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-99fdd027-5a66-4f17-8de8-7cf05889ad5f tempest-AttachVolumeShelveTestJSON-119116216 tempest-AttachVolumeShelveTestJSON-119116216-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56" status: 404 len: 111 microversion: 2.20 time: 0.028816 Apr 18 21:03:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 95/282] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:03:18 2023] GET /compute/v2.1/servers/8b9d151c-45d7-4172-ace6-65d16d94ae56 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:03:29 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:29 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:29 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-81c83e53-5ffa-4e6e-b98c-f841246e72cc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Action: 'create', calling method: .version_select at 0x7f51cffb96c0>, body: {"keypair": {"name": "tempest-keypair-1718975577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCatrlk8Gk1C9BIJU6Nq36ZHN2mvgVOFhKbNZOo+sHYhZjRTZoBia6bXIq9QYq+nS1cyGdMTreLYKGPgx+o2H7H6pHCB77qEztFCQxCUEXmBCUE5r3/rwDuglDWRoZEuqA=="}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:29 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-81c83e53-5ffa-4e6e-b98c-f841246e72cc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for project 4f87d615925045948bb95f84b990b2c5. Resources: {'key_pairs'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:03:29 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-81c83e53-5ffa-4e6e-b98c-f841246e72cc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for user 038d8b51fbcf4542a442e69729e90b52 and project 4f87d615925045948bb95f84b990b2c5. Resources: {'key_pairs'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:03:29 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-81c83e53-5ffa-4e6e-b98c-f841246e72cc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.177780 Apr 18 21:03:29 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 94/283] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:03:29 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:30 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-406631877", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b03bc1ed-f83c-4e48-86f7-e3e2aed9455a"}], "security_groups": [{"name": "tempest-securitygroup--1917103847"}], "key_name": "tempest-keypair-1718975577", "user_data": "}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:30 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:30 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:30 user devstack@n-api.service[61133]: DEBUG nova.network.neutron [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] validate_networks() for [('b03bc1ed-f83c-4e48-86f7-e3e2aed9455a', None, None, None, None, None)] {{(pid=61133) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Flavor limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Image limits 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Flavor pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Image pref 0:0:0 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.virt.hardware [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for project 4f87d615925045948bb95f84b990b2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for user 038d8b51fbcf4542a442e69729e90b52 and project 4f87d615925045948bb95f84b990b2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Going to run 1 instances... {{(pid=61133) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:03:31 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:03:31 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-c3341856-9751-483e-bb45-d8af6dc32891 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.660362 Apr 18 21:03:31 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 95/284] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:03:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:03:31 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=5 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:31 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:31 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-a57e9111-d467-40b9-a1aa-986d92229985 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:31 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a57e9111-d467-40b9-a1aa-986d92229985 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:31 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a57e9111-d467-40b9-a1aa-986d92229985 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:31 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-a57e9111-d467-40b9-a1aa-986d92229985 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 200 len: 1231 microversion: 2.1 time: 0.069993 Apr 18 21:03:31 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 96/285] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:31 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 1231 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:34 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:34 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] Creating event network-changed:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:03:34 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-52428807-a0b0-4e38-a013-cad9e25e08a0 req-cef7d9d3-1ba0-4cbf-a684-a754699f3337 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029447 Apr 18 21:03:34 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 95/286] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] [instance: 0de111c2-401c-497d-9f87-af914cc14710] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:36 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] HTTP exception thrown: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Request method failure captured: Apr 18 21:03:36 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 HTTP/1.1 Apr 18 21:03:36 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:03:36 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:03:36 user devstack@n-api.service[61133]: Connection: close Apr 18 21:03:36 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:03:36 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:03:36 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:03:36 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:03:36 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRCmgGz1_WA3txNZIn0vTDTnhc7eoyjg9FVadkA8Sjet2MheWN3-sGZgUehtvqyNK3cWSI0JE2WZxf1wIYjby4roDl6EkwTPRLD7JRidZdadoSOn7mfE82M9tPprjtbjIeCyIOwVNsFBG4m7y1wn-CE8k_RLlnwRyDrrNBpuvzp13c Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Project-Id: cc1123ea88c041ed82b64c982aac6a35 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Project-Name: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/cc1123ea88c041ed82b64c982aac6a35"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Tenant: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Tenant-Id: cc1123ea88c041ed82b64c982aac6a35 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-168114348 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-User: tempest-VolumesAdminNegativeTest-168114348-project-member Apr 18 21:03:36 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:03:36 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:03:36 user devstack@n-api.service[61133]: X-User-Id: e4224e9c1f5a47649dae0fd569edace2 Apr 18 21:03:36 user devstack@n-api.service[61133]: X-User-Name: tempest-VolumesAdminNegativeTest-168114348-project-member Apr 18 21:03:36 user devstack@n-api.service[61133]: method: > Apr 18 21:03:36 user devstack@n-api.service[61133]: exception: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. Apr 18 21:03:36 user devstack@n-api.service[61133]: action_args: {'id': '0de111c2-401c-497d-9f87-af914cc14710'} Apr 18 21:03:36 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. Apr 18 21:03:36 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:03:36 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Returning 404 to user: Instance 0de111c2-401c-497d-9f87-af914cc14710 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:36 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-55f856e9-139e-4fa4-a637-9ee9ddf7d709 tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710" status: 404 len: 111 microversion: 2.1 time: 0.162715 Apr 18 21:03:36 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 96/287] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:36 2023] GET /compute/v2.1/servers/0de111c2-401c-497d-9f87-af914cc14710 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:03:36 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-0ef5a531-fec1-41ad-8b52-dba3d6573ecc tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] Calling method '.version_select at 0x7f51cfe5d3f0>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:36 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "name": "network-vif-plugged", "status": "completed", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:36 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-0ef5a531-fec1-41ad-8b52-dba3d6573ecc tempest-VolumesAdminNegativeTest-168114348 tempest-VolumesAdminNegativeTest-168114348-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061000452" status: 202 len: 0 microversion: 2.1 time: 0.042895 Apr 18 21:03:36 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 97/288] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 21:03:36 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1061000452 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:03:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:36 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] Creating event network-vif-plugged:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:03:36 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-c712f47d-c20b-4fc2-8d96-3b41d84d6352 req-6d485f07-d821-4dc4-a99c-a67f20072e2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045449 Apr 18 21:03:36 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 96/289] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:38 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "name": "network-vif-plugged", "status": "completed", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:38 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] Creating event network-vif-plugged:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:03:38 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-4d3d6029-8f8c-4008-bc8f-ebbd86c880e6 req-8f52d97f-b944-4c8e-9519-fa5ac26001af service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035493 Apr 18 21:03:38 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 97/290] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:03:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:40 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:41 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:41 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-3165a457-eac1-4266-aa48-49b63a684da0 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.435282 Apr 18 21:03:41 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 98/291] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:40 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:41 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:41 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-f7eb55d4-e444-46b4-9ba9-a595a9d90654 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.369289 Apr 18 21:03:41 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 97/292] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:41 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=6 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:41 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:03:41 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-30959cbb-35fa-4dba-9e40-45715abfed20 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.362535 Apr 18 21:03:41 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 98/293] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:41 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:03:57 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:03:57 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 HTTP/1.1 Apr 18 21:03:57 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:03:57 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:03:57 user devstack@n-api.service[61135]: Connection: close Apr 18 21:03:57 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:03:57 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:03:57 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:03:57 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:03:57 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:03:57 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:03:57 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:03:57 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:03:57 user devstack@n-api.service[61135]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:03:57 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:03:57 user devstack@n-api.service[61135]: method: > Apr 18 21:03:57 user devstack@n-api.service[61135]: exception: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:03:57 user devstack@n-api.service[61135]: action_args: {'id': 'a81d8561-aac4-4087-9c97-6180a3fbfc45'} Apr 18 21:03:57 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:03:57 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:03:57 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:03:57 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-91c7e3ac-87b4-4071-8b5d-f094a1021a96 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 404 len: 111 microversion: 2.1 time: 0.190740 Apr 18 21:03:57 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 99/294] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:03:57 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:03:57 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-97c2d0a4-656c-4ab1-9943-1f21a3452c83 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '.version_select at 0x7f51cffbb0a0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:03:57 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:57 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=10 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:57 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-97c2d0a4-656c-4ab1-9943-1f21a3452c83 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-986065476" status: 202 len: 0 microversion: 2.1 time: 0.030518 Apr 18 21:03:57 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 98/295] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 21:03:57 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-986065476 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:03:58 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-feed94b4-aee6-4866-9d4c-c8fb2fe5db95 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: .version_select at 0x7f51cff98ca0>, body: {"keypair": {"name": "tempest-keypair-299609372", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVy8PfIJFGN8qhqvmQldPf40WwKk/iyefxgJUgnWQJ1PeNnXn+l14Qi6LgOcq8E1+s/+bDJin8cFlxNyQ53JQHWWVY3tta7gVu+deT+gk+1vNjPgSo10C1DEo+e/ropFg=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:03:58 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:58 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=12 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:03:58 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-feed94b4-aee6-4866-9d4c-c8fb2fe5db95 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:03:58 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-feed94b4-aee6-4866-9d4c-c8fb2fe5db95 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:03:58 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-feed94b4-aee6-4866-9d4c-c8fb2fe5db95 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.077053 Apr 18 21:03:58 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 99/296] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:03:58 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-605493339", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "c3b319de-2fa3-4858-b85a-891d6736ed6b"}], "security_groups": [{"name": "tempest-securitygroup--1412837513"}], "key_name": "tempest-keypair-299609372", "user_data": "}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] validate_networks() for [('c3b319de-2fa3-4858-b85a-891d6736ed6b', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Getting quotas for user 5370e1ed421443439d6463efd2fae614 and project 3a910c3017f1428c9f1c09133d73cfcc. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:04:00 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:04:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-c7223076-b499-4dab-bc1b-3f589746da6f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.841053 Apr 18 21:04:00 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 100/297] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:04:00 2023] POST /compute/v2.1/servers => generated 400 bytes in 843 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:04:00 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-efeec490-6089-4eef-9eee-cab4a5dd8109 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:00 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-efeec490-6089-4eef-9eee-cab4a5dd8109 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:01 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-efeec490-6089-4eef-9eee-cab4a5dd8109 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:01 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-efeec490-6089-4eef-9eee-cab4a5dd8109 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 200 len: 1234 microversion: 2.1 time: 0.074397 Apr 18 21:04:01 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 99/298] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:00 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 1234 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] [instance: afb0cff7-4b43-44b4-899e-90070124db3b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:02 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] HTTP exception thrown: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Request method failure captured: Apr 18 21:04:02 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b HTTP/1.1 Apr 18 21:04:02 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:04:02 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:04:02 user devstack@n-api.service[61133]: Connection: close Apr 18 21:04:02 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:04:02 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:04:02 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:04:02 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:04:02 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQ70UPSfi6ggO6lPth71k6h8i47p6yDbFRkKZ4hrVqYnqCWHNGcGb7KCZeP2dShQkkT0w4iOHzWIGTTfVcckuLYCVg7IYLxF3JgLfDq6mPL25FzZyoQoBTrb2VK1wHU_k9Hrs3EQGXiQY8DhUIp6ifxMrLaRtxRp5QNE7HFk5V7aZQ Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Project-Id: ef80599ace4b477c9a9222526789e3c6 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ef80599ace4b477c9a9222526789e3c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Tenant-Id: ef80599ace4b477c9a9222526789e3c6 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1697925108 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-User: tempest-ServerRescueNegativeTestJSON-1697925108-project-member Apr 18 21:04:02 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:04:02 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:04:02 user devstack@n-api.service[61133]: X-User-Id: 790ad228383143da97ce2b964b7fce07 Apr 18 21:04:02 user devstack@n-api.service[61133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1697925108-project-member Apr 18 21:04:02 user devstack@n-api.service[61133]: method: > Apr 18 21:04:02 user devstack@n-api.service[61133]: exception: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. Apr 18 21:04:02 user devstack@n-api.service[61133]: action_args: {'id': 'afb0cff7-4b43-44b4-899e-90070124db3b'} Apr 18 21:04:02 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. Apr 18 21:04:02 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:04:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] Returning 404 to user: Instance afb0cff7-4b43-44b4-899e-90070124db3b could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:04:02 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-39a1f63d-a2bf-4fe6-8628-9a15a082e0fe tempest-ServerRescueNegativeTestJSON-1697925108 tempest-ServerRescueNegativeTestJSON-1697925108-project-member] 10.0.0.210 "GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b" status: 404 len: 111 microversion: 2.1 time: 0.030604 Apr 18 21:04:02 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 100/299] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:02 2023] GET /compute/v2.1/servers/afb0cff7-4b43-44b4-899e-90070124db3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:04:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] Creating event network-changed:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:04:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-c5d41309-bd27-41da-8e06-7133f5128b57 req-79ec88c2-6d63-4e0d-ba86-146844b22b69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028250 Apr 18 21:04:03 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 101/300] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:05 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "name": "network-vif-plugged", "status": "completed", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:05 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] Creating event network-vif-plugged:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:04:05 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-156f8af1-698a-4d0d-9fdb-82f18aa2678e req-32957a31-f681-4146-bbc3-4e8094cf00e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037799 Apr 18 21:04:05 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 100/301] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:08 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "name": "network-vif-plugged", "status": "completed", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:08 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:08 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:08 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:08 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] Creating event network-vif-plugged:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:04:08 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-576016ba-0a40-4da3-8621-94be0f146d10 req-6299750a-ea75-440f-8602-746132d84d18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050543 Apr 18 21:04:08 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:04:10 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-ee91b4fb-5610-435e-ac97-acc0d12021de tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 204 len: 0 microversion: 2.1 time: 0.118405 Apr 18 21:04:10 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 102/303] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:04:10 2023] DELETE /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:10 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:10 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:10 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] Creating event network-vif-unplugged:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:04:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-26616992-a132-468b-9cd5-8a399343307c req-01dc3e7d-314a-4f9a-beb0-dc7d3734464f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043090 Apr 18 21:04:10 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 102/304] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:10 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:10 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-9c39e91f-3f2c-4c63-8c3b-03e3a2be370c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 200 len: 1500 microversion: 2.1 time: 0.335110 Apr 18 21:04:10 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 101/305] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:10 2023] GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 1500 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "name": "network-vif-deleted", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:11 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] Creating event network-vif-deleted:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:04:11 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-7b8df442-520b-482e-855c-34250a9fc70d req-d8edeee9-0985-4e3b-98d3-841958cc0bec service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037979 Apr 18 21:04:11 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 103/306] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 18 21:04:12 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "361eae1f-d5a7-434e-8946-82a0501644fb", "name": "network-vif-plugged", "status": "completed", "tag": "1f4c0ba6-127e-4044-8337-cb9333463993"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] Creating event network-vif-plugged:1f4c0ba6-127e-4044-8337-cb9333463993 for instance 361eae1f-d5a7-434e-8946-82a0501644fb on user Apr 18 21:04:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-cc9f80a9-c02a-4229-93cb-12f6da60161f req-0fe558cf-d720-4189-8ccd-d403ca690468 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029866 Apr 18 21:04:12 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 103/307] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:17 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1908143060", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "2776403b-74df-489f-a4f5-d994ce6e9319", "destination_type": "volume"}], "networks": [{"uuid": "2a459fb0-36eb-4c75-afd7-0de7482741f7"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:17 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:17 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] validate_networks() for [('2a459fb0-36eb-4c75-afd7-0de7482741f7', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Getting quotas for user e6caad8bd6fe44b6ab8868167473d4fe and project 8a5f1bfc384749baaf2a69eacad57b87. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:04:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:04:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-29cb19fd-1280-468b-bdf8-ecb52d5a033c tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.713848 Apr 18 21:04:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 102/308] 10.0.0.210 () {66 vars in 1265 bytes} [Tue Apr 18 21:04:17 2023] POST /compute/v2.1/servers => generated 378 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 18 21:04:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:18 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:18 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:18 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-fc91ffc5-9088-48ca-bed1-13841e0580e7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764" status: 200 len: 1395 microversion: 2.87 time: 0.139670 Apr 18 21:04:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 104/309] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:04:18 2023] GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764 => generated 1395 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:04:20 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b906f36-9eef-441d-acf1-d672eb602764", "tag": "40c05bd3-7114-4c70-b474-611f15aa16b1"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:20 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:20 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] Creating event network-changed:40c05bd3-7114-4c70-b474-611f15aa16b1 for instance 3b906f36-9eef-441d-acf1-d672eb602764 on user Apr 18 21:04:20 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-cb8bb799-05a8-42b0-8380-554aa9a5a5ff req-48f19933-3a93-4503-9d05-f0bfec9a3c9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032334 Apr 18 21:04:20 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 104/310] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:21 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:22 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-89dcd833-9528-4fb7-99b7-3d2e30f5fac1 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 200 len: 1537 microversion: 2.1 time: 0.419659 Apr 18 21:04:22 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 103/311] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:21 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 1537 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b906f36-9eef-441d-acf1-d672eb602764", "name": "network-vif-deleted", "tag": "40c05bd3-7114-4c70-b474-611f15aa16b1"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:22 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.compute.server_external_events [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] Unable to find a host for instance 3b906f36-9eef-441d-acf1-d672eb602764. Dropping event network-vif-deleted {{(pid=61135) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Apr 18 21:04:22 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-b92bdb3c-7d7a-4f65-b39f-97e01201eb76 req-324f405f-636d-4847-a60c-01fe1580249b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027736 Apr 18 21:04:22 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 105/312] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:04:22 2023] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:43 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:43 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-78c03597-3a96-44f6-9159-2a98aac7bf09 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.490923 Apr 18 21:04:43 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 105/313] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:43 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=16 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:04:51 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:04:51 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-f3ae2761-194b-4dc2-9429-7405e53d5dd4 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 200 len: 1544 microversion: 2.1 time: 0.233726 Apr 18 21:04:51 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 104/314] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:04:51 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 1544 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] HTTP exception thrown: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Request method failure captured: Apr 18 21:05:00 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb HTTP/1.1 Apr 18 21:05:00 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:05:00 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:05:00 user devstack@n-api.service[61135]: Connection: close Apr 18 21:05:00 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:05:00 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:05:00 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:05:00 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:05:00 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwTqhGO7H9wryvdCMwoJsxYRLk-sdKbGKN1V3YtshZsnZNLQWGgreU9HbqZB_OkuZA-BOsqzUogsvwejIaVO6Vjo_RlWjC4aGDIJ5yfOvsHpq2eNLZPx4xpuxuT2fn1rPq296p5Itb5s9ZEat1byyQA0kivZbIIJaRL3jSlZgjDDtmA Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Project-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Project-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e102abbb675645edbbd042f775e89e50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Tenant: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Tenant-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:05:00 user devstack@n-api.service[61135]: X-User: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:05:00 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:05:00 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:05:00 user devstack@n-api.service[61135]: X-User-Id: b36a393d92e948b1ada87c4823d14bee Apr 18 21:05:00 user devstack@n-api.service[61135]: X-User-Name: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:05:00 user devstack@n-api.service[61135]: method: > Apr 18 21:05:00 user devstack@n-api.service[61135]: exception: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:05:00 user devstack@n-api.service[61135]: action_args: {'id': '361eae1f-d5a7-434e-8946-82a0501644fb'} Apr 18 21:05:00 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:05:00 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Returning 404 to user: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:05:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-1a59f29e-83f8-4bde-a3e4-4a62273805c4 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 404 len: 111 microversion: 2.1 time: 0.033963 Apr 18 21:05:00 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 106/315] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:00 2023] GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=6 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:01 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:01 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-d355db08-1b26-467c-88fe-2e4cad150e13 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1494 microversion: 2.1 time: 0.223575 Apr 18 21:05:01 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 106/316] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:00 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1494 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.objects.instance [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lazy-loading 'fault' on Instance uuid 3b906f36-9eef-441d-acf1-d672eb602764 {{(pid=61134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:08 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-7ff27c8b-117a-49c2-b4dd-4f8f4452cade tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764" status: 200 len: 1650 microversion: 2.87 time: 0.138956 Apr 18 21:05:08 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 105/317] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:05:08 2023] GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764 => generated 1650 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Going to try to terminate instance {{(pid=61135) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Doing local delete in cell 88560d0d-7818-4020-888f-ef6d4621691d(cell1) {{(pid=61135) _delete /opt/stack/nova/nova/compute/api.py:2546}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:08 user devstack@n-api.service[61135]: WARNING nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] instance's host None is down, deleting from database Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] deallocate_for_instance() {{(pid=61135) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1793}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Instance cache missing network info. {{(pid=61135) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3313}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Updating instance_info_cache with network_info: [] {{(pid=61135) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Apr 18 21:05:08 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Unable to find connector for volume None, not attempting terminate_connection. {{(pid=61135) _local_cleanup_bdm_volumes /opt/stack/nova/nova/compute/api.py:2612}} Apr 18 21:05:08 user devstack@n-api.service[61135]: WARNING nova.compute.api [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Ignoring volume cleanup failure due to Volume None could not be found.: nova.exception.VolumeNotFound: Volume None could not be found. Apr 18 21:05:09 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-8cc2ff98-38a1-475f-8c15-38556c1ef1fa tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764" status: 204 len: 0 microversion: 2.87 time: 0.344497 Apr 18 21:05:09 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 107/318] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:05:08 2023] DELETE /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 3b906f36-9eef-441d-acf1-d672eb602764] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] HTTP exception thrown: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Request method failure captured: Apr 18 21:05:09 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764 HTTP/1.1 Apr 18 21:05:09 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:05:09 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:05:09 user devstack@n-api.service[61133]: Connection: close Apr 18 21:05:09 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:05:09 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:05:09 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:05:09 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:05:09 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQ2GLaTqnh_NdRKUw7KdgEdHFqYOFul2s74Z_3a1P0_egczQhVglCD-LeSSmDOSdMPkT5_t4rdPTfZHwA5TI8Uyb6Mpx_IaArkfq3r63Tkmi3WM1QoXGBaY_g2xpbtaThdbwDT4Vr6J4WXXFCf5y5c8yurEW9pgsDjpF0xknKN4dkw Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Project-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Tenant-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:09 user devstack@n-api.service[61133]: X-User: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:05:09 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:05:09 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:05:09 user devstack@n-api.service[61133]: X-User-Id: e6caad8bd6fe44b6ab8868167473d4fe Apr 18 21:05:09 user devstack@n-api.service[61133]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:05:09 user devstack@n-api.service[61133]: method: > Apr 18 21:05:09 user devstack@n-api.service[61133]: exception: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. Apr 18 21:05:09 user devstack@n-api.service[61133]: action_args: {'id': '3b906f36-9eef-441d-acf1-d672eb602764'} Apr 18 21:05:09 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. Apr 18 21:05:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Returning 404 to user: Instance 3b906f36-9eef-441d-acf1-d672eb602764 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:05:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-03c6289f-0980-487a-a09a-b7f3dade4013 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764" status: 404 len: 111 microversion: 2.87 time: 0.036191 Apr 18 21:05:09 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 107/319] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:05:09 2023] GET /compute/v2.1/servers/3b906f36-9eef-441d-acf1-d672eb602764 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:05:09 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-190993c4-548f-452e-82f4-19d4aa979e9f tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 204 len: 0 microversion: 2.87 time: 0.115036 Apr 18 21:05:09 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 106/320] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:05:09 2023] DELETE /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "name": "network-vif-unplugged", "status": "completed", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] Creating event network-vif-unplugged:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:05:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-3ccb0577-5c6a-41dd-8705-e2f71ca321ac req-aed7f9c7-acb5-47c6-8f53-f92f51d7eabd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029035 Apr 18 21:05:09 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 108/321] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:09 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:09 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:09 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-39f3fb81-a517-421e-89b3-85d78c96eddb tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 200 len: 1697 microversion: 2.87 time: 0.422367 Apr 18 21:05:09 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 108/322] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:05:09 2023] GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 1697 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:05:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "name": "network-vif-plugged", "status": "completed", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}, {"server_uuid": "f65d46e4-3ffe-4340-a930-a14a74b542c1", "name": "network-vif-deleted", "tag": "f611510d-0463-41f4-8304-4f22b98ea694"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Creating event network-vif-plugged:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:05:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] Creating event network-vif-deleted:f611510d-0463-41f4-8304-4f22b98ea694 for instance f65d46e4-3ffe-4340-a930-a14a74b542c1 on user Apr 18 21:05:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-960debb8-1080-4794-b813-73a054074fdf req-5e580726-2062-4e3b-8867-ba0e3e874603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033806 Apr 18 21:05:11 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 107/323] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=6 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:22 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:22 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-66e733d7-7739-4645-81b8-7a4f743830fc tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.165295 Apr 18 21:05:22 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 109/324] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:05:22 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386/os-interface => generated 283 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] Creating event network-changed:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:05:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-5a5deba4-8c80-44ef-9f4f-7960fb4f4365 req-7c950c99-9e3e-4681-8c01-e5ab48df8dda service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034794 Apr 18 21:05:23 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 109/325] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-9227c37d-8c8f-4731-8396-b42232ded466 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386/ips" status: 200 len: 104 microversion: 2.1 time: 0.044438 Apr 18 21:05:23 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 108/326] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:05:23 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386/ips => generated 104 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:24 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:05:24 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-95695c8a-9d2d-4d06-9d4a-357e828c7649 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 204 len: 0 microversion: 2.1 time: 0.112374 Apr 18 21:05:24 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 110/327] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:05:24 2023] DELETE /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:24 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:25 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "name": "network-vif-unplugged", "status": "completed", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:25 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:25 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-a45ddd4e-e9ca-4240-b3fb-275a05b5e662 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 200 len: 1662 microversion: 2.1 time: 0.353555 Apr 18 21:05:25 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 110/328] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:24 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 1662 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] Creating event network-vif-unplugged:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:05:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-dfab9864-5f08-4387-8916-b44019fa316f req-72315a40-5ab3-4eb4-bea5-4967deac0e9f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034313 Apr 18 21:05:25 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 109/329] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:25 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:26 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "name": "network-vif-deleted", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:26 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:26 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] Creating event network-vif-deleted:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:05:26 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-1af199e3-dfb7-4ffe-a4e6-689f85b553fb req-33b01d37-abcd-4587-acae-6571614ce7f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029706 Apr 18 21:05:26 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 111/330] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:27 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8550a1f5-306b-4396-bd98-7ccc4dd3b386", "name": "network-vif-plugged", "status": "completed", "tag": "fe6f321f-4360-4cba-b6bb-f34e14572395"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] Creating event network-vif-plugged:fe6f321f-4360-4cba-b6bb-f34e14572395 for instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 on user Apr 18 21:05:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-66426466-cb15-46b7-8174-2d217768986f req-4bc01d33-095d-4f11-b59b-c71cab0828f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030897 Apr 18 21:05:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 111/331] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:43 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:44 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:44 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6a2b3387-befd-43b7-b656-38a2b363c386 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.251009 Apr 18 21:05:44 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 110/332] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:43 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:44 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:44 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-5e105681-9d0b-4d70-97b9-6501b686825c tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.173145 Apr 18 21:05:44 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 112/333] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:44 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=10 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:44 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:44 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e7045529-d67f-4a38-9b32-d758a758d8cd tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.269308 Apr 18 21:05:44 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 112/334] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:44 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:51 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:51 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-c88348d6-1638-456c-b267-4f8726f08dfe tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.171589 Apr 18 21:05:51 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 111/335] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:05:51 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6/os-interface => generated 282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:52 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:52 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:52 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:52 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:52 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] Creating event network-changed:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:05:52 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-dd3645cd-f6fa-44c3-908f-89f0125cc7b0 req-b02de105-6661-49b7-96b0-22e0aeec2b60 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026811 Apr 18 21:05:52 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 113/336] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:52 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:52 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-1d404a46-a2b4-4ee0-9eed-77ab5fa7ee64 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6/ips" status: 200 len: 108 microversion: 2.1 time: 0.035356 Apr 18 21:05:52 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 113/337] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:05:52 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6/ips => generated 108 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:53 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:05:53 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-c3caee73-8d84-4ded-9741-81c059bc7e46 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 204 len: 0 microversion: 2.1 time: 0.109892 Apr 18 21:05:53 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 112/338] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:05:53 2023] DELETE /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:53 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:54 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5370e1ed421443439d6463efd2fae614', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a910c3017f1428c9f1c09133d73cfcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:05:54 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-a33ecae3-38e5-4552-b761-8581daf3d1aa tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 200 len: 1667 microversion: 2.1 time: 0.191556 Apr 18 21:05:54 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 114/339] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:05:53 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 1667 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:05:54 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "name": "network-vif-unplugged", "status": "completed", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:54 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:54 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:54 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:54 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] Creating event network-vif-unplugged:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:05:54 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-7bb8eb2f-7995-45d3-9a0f-3b9571ac73fc req-23c95780-c257-41ab-97de-43ba22d35a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027026 Apr 18 21:05:54 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 114/340] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:54 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:55 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "name": "network-vif-deleted", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:55 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:55 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] Creating event network-vif-deleted:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:05:55 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-19f3e9ce-198a-40ef-b746-9400293f49ba req-fed21330-58a0-482a-9c63-9e7bff6aaa56 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028548 Apr 18 21:05:55 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 113/341] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:56 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d51a86c-7846-462e-967c-95473aca79f6", "name": "network-vif-plugged", "status": "completed", "tag": "c420da63-c683-4d1c-9603-4bac6e9afa12"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:05:56 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:56 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:56 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:56 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] Creating event network-vif-plugged:c420da63-c683-4d1c-9603-4bac6e9afa12 for instance 4d51a86c-7846-462e-967c-95473aca79f6 on user Apr 18 21:05:56 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-4cf0bcdc-4587-464e-85a7-4b45292d9652 req-76d7811f-dde5-4437-a82f-5776cb5f53b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029163 Apr 18 21:05:56 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 115/342] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:05:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: f65d46e4-3ffe-4340-a930-a14a74b542c1] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:05:59 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] HTTP exception thrown: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Request method failure captured: Apr 18 21:05:59 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 HTTP/1.1 Apr 18 21:05:59 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:05:59 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:05:59 user devstack@n-api.service[61135]: Connection: close Apr 18 21:05:59 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:05:59 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:05:59 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:05:59 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:05:59 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwQ2GLaTqnh_NdRKUw7KdgEdHFqYOFul2s74Z_3a1P0_egczQhVglCD-LeSSmDOSdMPkT5_t4rdPTfZHwA5TI8Uyb6Mpx_IaArkfq3r63Tkmi3WM1QoXGBaY_g2xpbtaThdbwDT4Vr6J4WXXFCf5y5c8yurEW9pgsDjpF0xknKN4dkw Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Project-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Tenant-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:05:59 user devstack@n-api.service[61135]: X-User: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:05:59 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:05:59 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:05:59 user devstack@n-api.service[61135]: X-User-Id: e6caad8bd6fe44b6ab8868167473d4fe Apr 18 21:05:59 user devstack@n-api.service[61135]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:05:59 user devstack@n-api.service[61135]: method: > Apr 18 21:05:59 user devstack@n-api.service[61135]: exception: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. Apr 18 21:05:59 user devstack@n-api.service[61135]: action_args: {'id': 'f65d46e4-3ffe-4340-a930-a14a74b542c1'} Apr 18 21:05:59 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. Apr 18 21:05:59 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:05:59 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Returning 404 to user: Instance f65d46e4-3ffe-4340-a930-a14a74b542c1 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:05:59 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-2a3bad9f-f2e9-4596-a865-89c5fc168ba7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1" status: 404 len: 111 microversion: 2.87 time: 0.032633 Apr 18 21:05:59 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 115/343] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:05:59 2023] GET /compute/v2.1/servers/f65d46e4-3ffe-4340-a930-a14a74b542c1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:00 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:06:00 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-81e93eda-2dad-4470-9476-768a3885a7dc tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 204 len: 0 microversion: 2.87 time: 0.113964 Apr 18 21:06:00 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 114/344] 10.0.0.210 () {64 vars in 1357 bytes} [Tue Apr 18 21:06:00 2023] DELETE /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:00 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-unplugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:00 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] Creating event network-vif-unplugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 21:06:00 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-30b35de5-fe9c-4e89-b0a6-2062267a3bfc req-f025f98a-94f9-4981-9d58-b8420e75cb1c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032193 Apr 18 21:06:00 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 116/345] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:00 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e6caad8bd6fe44b6ab8868167473d4fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a5f1bfc384749baaf2a69eacad57b87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:00 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-3e8ea8dc-d770-4eb4-a34f-84d4a23d60d2 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 200 len: 1696 microversion: 2.87 time: 0.282361 Apr 18 21:06:00 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 116/346] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:06:00 2023] GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 1696 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 18 21:06:01 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-deleted", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:01 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:01 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:01 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:01 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] Creating event network-vif-deleted:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 21:06:01 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-d46b09e8-bc97-4c45-baa2-6d055a3009b6 req-32111a6e-7782-4972-bf72-f0e6e48195ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032884 Apr 18 21:06:01 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 115/347] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}, {"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}, {"server_uuid": "72db6ee7-c1f6-46ef-b368-c1273e35ee3c", "name": "network-vif-plugged", "status": "completed", "tag": "f3b47128-cae5-4e6f-841b-40270431ab95"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Creating event network-vif-plugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 21:06:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Creating event network-vif-plugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 21:06:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] Creating event network-vif-plugged:f3b47128-cae5-4e6f-841b-40270431ab95 for instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c on user Apr 18 21:06:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-d8d55a0b-cba6-4f9a-bac6-0574cc710dba req-9c8ee629-59ae-41ec-abb7-bfdd2ab89768 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.032824 Apr 18 21:06:02 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 117/348] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:02 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:02 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:03 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-45199c72-3225-44da-873b-cef172a857f3 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1494 microversion: 2.1 time: 0.637890 Apr 18 21:06:03 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 117/349] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:02 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1494 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:15 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:06:15 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 HTTP/1.1 Apr 18 21:06:15 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:06:15 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:06:15 user devstack@n-api.service[61134]: Connection: close Apr 18 21:06:15 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:06:15 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:06:15 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:06:15 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:06:15 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:06:15 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:06:15 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:06:15 user devstack@n-api.service[61134]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:06:15 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:06:15 user devstack@n-api.service[61134]: method: > Apr 18 21:06:15 user devstack@n-api.service[61134]: exception: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:06:15 user devstack@n-api.service[61134]: action_args: {'id': '8550a1f5-306b-4396-bd98-7ccc4dd3b386'} Apr 18 21:06:15 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:06:15 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:15 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:15 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-cca40858-a75b-459a-9b16-7cda6f8b35e3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 404 len: 111 microversion: 2.1 time: 0.037579 Apr 18 21:06:15 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 116/350] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:15 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:15 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=12 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=18 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-327e3d7c-c017-40b8-9c1b-0c5f16c0f8b7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '.version_select at 0x7f51cfe5e320>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:15 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-327e3d7c-c017-40b8-9c1b-0c5f16c0f8b7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718975577" status: 202 len: 0 microversion: 2.1 time: 0.029803 Apr 18 21:06:15 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 118/351] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 21:06:15 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1718975577 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:06:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-8397d42e-8015-4599-ac14-83b660599b08 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Action: 'create', calling method: .version_select at 0x7f51d42fb760>, body: {"keypair": {"name": "tempest-keypair-1059955912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3iVWOT5Fr9diDoCuQjAcwm14WaI1sND9YignhnPZABtlhqs2m8YMe61wGCVtvyCWkhFbuVrkRlWimGPlBX8W+9vucDAQ3O6e+846ZA+PC2GjFO9mJYIFew//dgoapIHg=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:15 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=14 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=28 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:15 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-8397d42e-8015-4599-ac14-83b660599b08 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for project 4f87d615925045948bb95f84b990b2c5. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:06:15 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-8397d42e-8015-4599-ac14-83b660599b08 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for user 038d8b51fbcf4542a442e69729e90b52 and project 4f87d615925045948bb95f84b990b2c5. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:06:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-8397d42e-8015-4599-ac14-83b660599b08 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045990 Apr 18 21:06:16 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 118/352] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:06:15 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-25043030", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b03bc1ed-f83c-4e48-86f7-e3e2aed9455a"}], "security_groups": [{"name": "tempest-securitygroup--264971998"}], "key_name": "tempest-keypair-1059955912", "user_data": "}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] validate_networks() for [('b03bc1ed-f83c-4e48-86f7-e3e2aed9455a', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for project 4f87d615925045948bb95f84b990b2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Getting quotas for user 038d8b51fbcf4542a442e69729e90b52 and project 4f87d615925045948bb95f84b990b2c5. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:06:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:06:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-2b3cc325-3544-4dca-be21-d69ce642b2f7 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.744918 Apr 18 21:06:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 117/353] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:06:18 2023] POST /compute/v2.1/servers => generated 399 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:06:18 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-e81fdb88-919e-4c2c-9816-b22527de7c7c tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:18 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-e81fdb88-919e-4c2c-9816-b22527de7c7c tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:18 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-e81fdb88-919e-4c2c-9816-b22527de7c7c tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:18 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-e81fdb88-919e-4c2c-9816-b22527de7c7c tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 200 len: 1230 microversion: 2.1 time: 0.087666 Apr 18 21:06:18 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 119/354] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:18 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 1230 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:06:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:21 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] Creating event network-changed:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:06:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-25a2339d-a37c-4f9a-bded-57c3d15a03e2 req-1a8b6c7e-618a-4eeb-a31b-b9bd73939a68 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028032 Apr 18 21:06:21 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 119/355] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:23 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "name": "network-vif-plugged", "status": "completed", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:23 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] Creating event network-vif-plugged:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:06:23 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-9b148357-8015-46c1-8877-df697cf0ca20 req-c222c113-e6eb-41b2-b794-5df6993c33e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094182 Apr 18 21:06:23 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 118/356] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:25 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "name": "network-vif-plugged", "status": "completed", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:06:25 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:25 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:25 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:25 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] Creating event network-vif-plugged:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:06:25 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-4cdfd076-d8c3-49ef-a30a-96d488373b82 req-d47f36da-5daa-432c-aa82-60321f80abed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030308 Apr 18 21:06:25 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 120/357] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:06:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:44 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:44 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 HTTP/1.1 Apr 18 21:06:44 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:06:44 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:06:44 user devstack@n-api.service[61133]: Connection: close Apr 18 21:06:44 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:06:44 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:06:44 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:06:44 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:06:44 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:44 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:44 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:06:44 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:06:44 user devstack@n-api.service[61133]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:44 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:44 user devstack@n-api.service[61133]: method: > Apr 18 21:06:44 user devstack@n-api.service[61133]: exception: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:44 user devstack@n-api.service[61133]: action_args: {'id': '4d51a86c-7846-462e-967c-95473aca79f6'} Apr 18 21:06:44 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:44 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:44 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:44 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-ce9e8cff-b186-4f35-9b15-1fe5bf1e1803 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 404 len: 111 microversion: 2.1 time: 0.038678 Apr 18 21:06:44 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 120/358] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:44 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:44 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-393a4c17-552c-45fd-ba87-df6112ebaba6 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '.version_select at 0x7f51cffb9fc0>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:44 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-393a4c17-552c-45fd-ba87-df6112ebaba6 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-299609372" status: 202 len: 0 microversion: 2.1 time: 0.030302 Apr 18 21:06:44 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 119/359] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 21:06:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-299609372 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:44 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61135]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61135]: method: > Apr 18 21:06:45 user devstack@n-api.service[61135]: exception: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: action_args: {'id': '4d51a86c-7846-462e-967c-95473aca79f6'} Apr 18 21:06:45 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-34d536ce-3241-4510-8f95-3468b255bb05 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 404 len: 111 microversion: 2.1 time: 0.044349 Apr 18 21:06:45 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 121/360] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:06:44 2023] DELETE /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 4d51a86c-7846-462e-967c-95473aca79f6] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61133]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61133]: method: > Apr 18 21:06:45 user devstack@n-api.service[61133]: exception: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: action_args: {'id': '4d51a86c-7846-462e-967c-95473aca79f6'} Apr 18 21:06:45 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 4d51a86c-7846-462e-967c-95473aca79f6 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-187175f8-3cfd-45e6-b5b5-67a6b5040f8f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6" status: 404 len: 111 microversion: 2.1 time: 0.026153 Apr 18 21:06:45 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 121/361] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:45 2023] GET /compute/v2.1/servers/4d51a86c-7846-462e-967c-95473aca79f6 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61134]: request: DELETE /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61134]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61134]: method: > Apr 18 21:06:45 user devstack@n-api.service[61134]: exception: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: action_args: {'id': 'a81d8561-aac4-4087-9c97-6180a3fbfc45'} Apr 18 21:06:45 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-e89a8fbe-b8f8-4a32-b374-c02ff07e896a tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 404 len: 111 microversion: 2.1 time: 0.027691 Apr 18 21:06:45 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 120/362] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:06:45 2023] DELETE /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: a81d8561-aac4-4087-9c97-6180a3fbfc45] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61135]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61135]: method: > Apr 18 21:06:45 user devstack@n-api.service[61135]: exception: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: action_args: {'id': 'a81d8561-aac4-4087-9c97-6180a3fbfc45'} Apr 18 21:06:45 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. Apr 18 21:06:45 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance a81d8561-aac4-4087-9c97-6180a3fbfc45 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-f05be76e-eff9-4e76-bbf0-a8f0ae807e09 tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45" status: 404 len: 111 microversion: 2.1 time: 0.033725 Apr 18 21:06:45 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 122/363] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:45 2023] GET /compute/v2.1/servers/a81d8561-aac4-4087-9c97-6180a3fbfc45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61133]: request: DELETE /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61133]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61133]: method: > Apr 18 21:06:45 user devstack@n-api.service[61133]: exception: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: action_args: {'id': '12094087-b11e-4575-b6b3-09fb4091588b'} Apr 18 21:06:45 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-622328a1-d5ed-4ac3-8ed6-36ac9165185c tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 404 len: 111 microversion: 2.1 time: 0.027852 Apr 18 21:06:45 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 122/364] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:06:45 2023] DELETE /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] [instance: 12094087-b11e-4575-b6b3-09fb4091588b] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:45 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] HTTP exception thrown: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Request method failure captured: Apr 18 21:06:45 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b HTTP/1.1 Apr 18 21:06:45 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:06:45 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:06:45 user devstack@n-api.service[61134]: Connection: close Apr 18 21:06:45 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:06:45 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:06:45 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:06:45 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:06:45 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwRvprRsNwmwlbH-Hlu3c9XBtvnVxxT9aCPCZsLFCVvT3HFPVSSJUHbB5kdLhQkACSWfyRggpaLsQ4iIGY7uXG4Ief1kibel5kE1lTyHvA5sRbfUeW0nkyMNaAcHjALdqWmnYIq25apC2ywPWSt1Ho5LdSFywGgsM0D0DGJXN_4W4L4 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3a910c3017f1428c9f1c09133d73cfcc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant-Id: 3a910c3017f1428c9f1c09133d73cfcc Apr 18 21:06:45 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-25072355 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Id: 5370e1ed421443439d6463efd2fae614 Apr 18 21:06:45 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeNegativeTest-25072355-project-member Apr 18 21:06:45 user devstack@n-api.service[61134]: method: > Apr 18 21:06:45 user devstack@n-api.service[61134]: exception: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: action_args: {'id': '12094087-b11e-4575-b6b3-09fb4091588b'} Apr 18 21:06:45 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. Apr 18 21:06:45 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:06:45 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] Returning 404 to user: Instance 12094087-b11e-4575-b6b3-09fb4091588b could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:45 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-b2db2bf0-747c-454b-88d0-487a25108f4f tempest-AttachVolumeNegativeTest-25072355 tempest-AttachVolumeNegativeTest-25072355-project-member] 10.0.0.210 "GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b" status: 404 len: 111 microversion: 2.1 time: 0.027359 Apr 18 21:06:45 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 121/365] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:45 2023] GET /compute/v2.1/servers/12094087-b11e-4575-b6b3-09fb4091588b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:46 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:06:46 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-f75cdb63-37f9-47aa-9de7-56c5d0bb92e6 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1657 microversion: 2.1 time: 0.227596 Apr 18 21:06:46 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 123/366] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:06:46 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1657 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] [instance: 72db6ee7-c1f6-46ef-b368-c1273e35ee3c] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:06:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] HTTP exception thrown: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Request method failure captured: Apr 18 21:06:50 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c HTTP/1.1 Apr 18 21:06:50 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:06:50 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:06:50 user devstack@n-api.service[61133]: Connection: close Apr 18 21:06:50 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:06:50 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:06:50 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:06:50 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:06:50 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwQ2GLaTqnh_NdRKUw7KdgEdHFqYOFul2s74Z_3a1P0_egczQhVglCD-LeSSmDOSdMPkT5_t4rdPTfZHwA5TI8Uyb6Mpx_IaArkfq3r63Tkmi3WM1QoXGBaY_g2xpbtaThdbwDT4Vr6J4WXXFCf5y5c8yurEW9pgsDjpF0xknKN4dkw Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Openstack-Nova-Api-Version: 2.87 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Project-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8a5f1bfc384749baaf2a69eacad57b87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Tenant-Id: 8a5f1bfc384749baaf2a69eacad57b87 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132 Apr 18 21:06:50 user devstack@n-api.service[61133]: X-User: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:06:50 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:06:50 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:06:50 user devstack@n-api.service[61133]: X-User-Id: e6caad8bd6fe44b6ab8868167473d4fe Apr 18 21:06:50 user devstack@n-api.service[61133]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member Apr 18 21:06:50 user devstack@n-api.service[61133]: method: > Apr 18 21:06:50 user devstack@n-api.service[61133]: exception: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. Apr 18 21:06:50 user devstack@n-api.service[61133]: action_args: {'id': '72db6ee7-c1f6-46ef-b368-c1273e35ee3c'} Apr 18 21:06:50 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. Apr 18 21:06:50 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:06:50 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] Returning 404 to user: Instance 72db6ee7-c1f6-46ef-b368-c1273e35ee3c could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:06:50 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-02fe1b69-b3db-4dd6-8ecc-68ed99e3dff7 tempest-ServerBootFromVolumeStableRescueTest-241821132 tempest-ServerBootFromVolumeStableRescueTest-241821132-project-member] 10.0.0.210 "GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c" status: 404 len: 111 microversion: 2.87 time: 0.032963 Apr 18 21:06:50 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 123/367] 10.0.0.210 () {64 vars in 1354 bytes} [Tue Apr 18 21:06:50 2023] GET /compute/v2.1/servers/72db6ee7-c1f6-46ef-b368-c1273e35ee3c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:04 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:07:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ad594354-8654-4380-b0eb-ade2131c3238 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1494 microversion: 2.1 time: 0.683870 Apr 18 21:07:04 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 122/368] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:07:03 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1494 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=10 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:09 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:07:09 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-8b41c236-7d18-4157-a6ec-f3bbb8fdcf34 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 200 len: 1534 microversion: 2.1 time: 0.266659 Apr 18 21:07:09 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 124/369] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:07:08 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 1534 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:07:25 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-eef7eb44-2700-46ec-b0d0-0459f1d1e406 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Action: 'create', calling method: .version_select at 0x7f51d42a7d00>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-624336600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIkHLfWZtsDX1wFLiZ/CLl2LZNnp+Gmb9NfPdiZwLMJ+em33t/PX/2xKxE0UG/NTbuCYLmimDoVDx5AGGVXtgyINyETgKdWwlr17YGk/gJiWMj+PN3Vb3uquEw7FpHadA=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:25 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=8 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=8 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-eef7eb44-2700-46ec-b0d0-0459f1d1e406 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:07:25 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-eef7eb44-2700-46ec-b0d0-0459f1d1e406 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for user 8c2d545b5459472990722072dcf2095c and project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:07:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-eef7eb44-2700-46ec-b0d0-0459f1d1e406 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061591 Apr 18 21:07:25 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 124/370] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:07:25 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1813784098", "imageRef": "13a03f59-f61d-4d28-b054-d65b85726bb1", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-624336600", "networks": [{"uuid": "bbd69050-7c4f-467f-831b-bff2a5009ae5"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] validate_networks() for [('bbd69050-7c4f-467f-831b-bff2a5009ae5', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for user 8c2d545b5459472990722072dcf2095c and project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:07:25 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='13a03f59-f61d-4d28-b054-d65b85726bb1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:07:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-0084fc05-f582-465c-811d-8e525d1dbde9 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.710758 Apr 18 21:07:25 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 123/371] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:07:25 2023] POST /compute/v2.1/servers => generated 378 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:07:25 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-2dc3f42b-d6ef-43bb-8b1f-0838a1bbcaa0 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:07:25 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-2dc3f42b-d6ef-43bb-8b1f-0838a1bbcaa0 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:07:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:25 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-2dc3f42b-d6ef-43bb-8b1f-0838a1bbcaa0 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:07:26 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-2dc3f42b-d6ef-43bb-8b1f-0838a1bbcaa0 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 200 len: 1252 microversion: 2.1 time: 0.082183 Apr 18 21:07:26 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 125/372] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:07:25 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 1252 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:07:28 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:28 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] Creating event network-changed:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:07:28 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-e19f07e4-18c7-4848-a1f0-a8d901a51030 req-8137108d-6387-40ee-bc32-16d6a2f94321 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027107 Apr 18 21:07:28 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 125/373] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:31 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:31 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:31 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:07:31 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-e09b7878-26a9-4a8a-a62f-3d4864b660f3 req-da686ed4-ec65-4e8d-8a6c-4004b40f0d29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028477 Apr 18 21:07:31 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 124/374] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:33 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:33 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:07:33 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-2501e255-a7eb-4762-9ce3-7b897d9c6f50 req-28a81a67-2530-4422-a751-d015dbd52fd6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032481 Apr 18 21:07:33 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 126/375] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:46 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:47 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:07:47 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0bf8542e-b6ab-4328-bd80-bcc3266a3237 tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 204 len: 0 microversion: 2.1 time: 0.118979 Apr 18 21:07:47 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 126/376] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:07:46 2023] DELETE /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:47 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e035553eec70421e9b8dc1eff337b4a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e745786188a8467e91ee32d4078f12b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:07:47 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6c9f5afa-f81b-42a0-9f52-4c33f0de689e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 200 len: 1663 microversion: 2.1 time: 0.271959 Apr 18 21:07:47 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 125/377] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:07:47 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 1663 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "name": "network-vif-unplugged", "status": "completed", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:47 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:47 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] Creating event network-vif-unplugged:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 21:07:47 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-f9a8ae8d-cac6-411d-8470-22a7bbd2576e req-1c1c899d-389d-4bce-b8ba-5b59f853bc6a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.159248 Apr 18 21:07:47 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 127/378] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:49 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "name": "network-vif-deleted", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:49 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:49 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:49 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:49 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] Creating event network-vif-deleted:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 21:07:49 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-b666076b-73d3-487c-8ee3-bccc82551b49 req-129f2ab9-6d9c-4975-bdd8-875d3bd9258f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229472 Apr 18 21:07:49 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 127/379] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:07:49 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "335c54b1-9709-4d22-a947-49e98fbd72dd", "name": "network-vif-plugged", "status": "completed", "tag": "13709606-6a56-4d90-87bf-fdd8afa42a3d"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:07:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:07:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:07:49 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:07:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] Creating event network-vif-plugged:13709606-6a56-4d90-87bf-fdd8afa42a3d for instance 335c54b1-9709-4d22-a947-49e98fbd72dd on user Apr 18 21:07:49 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-7e02fefa-ed83-43fc-9e34-48c98120fd6e req-741fc485-c36a-4292-99a3-7c41780b1372 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Apr 18 21:07:49 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 126/380] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:07:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:05 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:08:05 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d2cf3aa9-b58b-4ac2-bada-ec2bfc65fdc8 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1494 microversion: 2.1 time: 0.237867 Apr 18 21:08:05 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 128/381] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:08:05 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1494 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-cffe2770-b72a-445d-840a-99ec745b8456 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.260987 Apr 18 21:08:09 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 128/382] 10.0.0.210 () {62 vars in 1352 bytes} [Tue Apr 18 21:08:09 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe/os-interface => generated 282 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=8 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:10 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:10 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] Creating event network-changed:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:08:10 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-ae4b40c2-a9ca-443d-8260-49ca9a407b0d req-012a7be3-f267-4034-a357-12ea48edb2d7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032838 Apr 18 21:08:10 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 127/383] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:08:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:10 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:10 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5e0281bc-3c9f-497c-8c83-a6eabdfa5ad9 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe/ips" status: 200 len: 103 microversion: 2.1 time: 0.042842 Apr 18 21:08:10 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 129/384] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:08:10 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe/ips => generated 103 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:11 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:08:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-9b986e7d-8024-4fff-a33b-8d0eddf46fc2 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 204 len: 0 microversion: 2.1 time: 0.111802 Apr 18 21:08:12 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 129/385] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:08:11 2023] DELETE /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:12 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038d8b51fbcf4542a442e69729e90b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f87d615925045948bb95f84b990b2c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:08:12 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-e5debae8-3c99-41f1-989e-5798246e617f tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 200 len: 1657 microversion: 2.1 time: 0.173217 Apr 18 21:08:12 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 128/386] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:08:12 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 1657 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 18 21:08:12 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "name": "network-vif-unplugged", "status": "completed", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:08:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:12 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:12 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] Creating event network-vif-unplugged:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:08:12 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-77a9e8f2-e0eb-4bf7-9daf-1e87ca275ea5 req-69128b45-7688-420c-946a-4865bc9e638d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088957 Apr 18 21:08:12 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 130/387] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:08:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:13 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "name": "network-vif-deleted", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:08:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] Creating event network-vif-deleted:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:08:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-85dbfa6d-b178-4c06-8660-7546ad84fd39 req-b655fc15-7cac-48b3-bfb2-5af45456a909 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027497 Apr 18 21:08:13 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 130/388] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:08:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde5fac0-7811-46d3-a441-40defca2aebe", "name": "network-vif-plugged", "status": "completed", "tag": "3953fb7d-2cb1-4c88-9d30-a3122e40d2eb"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:08:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] Creating event network-vif-plugged:3953fb7d-2cb1-4c88-9d30-a3122e40d2eb for instance cde5fac0-7811-46d3-a441-40defca2aebe on user Apr 18 21:08:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-0e6295e0-1992-4d39-9d7d-fdcd5e8d8693 req-696bc6bf-35cc-4dbc-bfdb-a34987e19ea6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031426 Apr 18 21:08:14 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 129/389] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:08:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:16 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:08:16 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-1d797a04-7ad3-4630-b92c-6f46494f5829 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 200 len: 1537 microversion: 2.1 time: 0.274268 Apr 18 21:08:16 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 131/390] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:08:16 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 1537 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] [instance: 335c54b1-9709-4d22-a947-49e98fbd72dd] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:08:37 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] HTTP exception thrown: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Request method failure captured: Apr 18 21:08:37 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd HTTP/1.1 Apr 18 21:08:37 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:08:37 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:08:37 user devstack@n-api.service[61133]: Connection: close Apr 18 21:08:37 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:08:37 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:08:37 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:08:37 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:08:37 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwSMWptrK1nQs8tUACxXxGS38MECIk1BG_8mtWW6yVfxBE2ZOC9zcHidOJHQcKxF_mNF9lk2POkO-VGVDgGCRgd4nnp3YzJE1XvYHIPIkiFVd3ez3GqKWWlwIMBor6nDAIfYTg9QmSAMmZR5v0_0ZZfdKmFmJBZJW4xDI7WvvfabrEA Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Project-Id: e745786188a8467e91ee32d4078f12b5 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServerActionsTestJSON-231415031 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e745786188a8467e91ee32d4078f12b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e745786188a8467e91ee32d4078f12b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e745786188a8467e91ee32d4078f12b5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Tenant: tempest-ServerActionsTestJSON-231415031 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Tenant-Id: e745786188a8467e91ee32d4078f12b5 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServerActionsTestJSON-231415031 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-User: tempest-ServerActionsTestJSON-231415031-project-member Apr 18 21:08:37 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:08:37 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:08:37 user devstack@n-api.service[61133]: X-User-Id: e035553eec70421e9b8dc1eff337b4a5 Apr 18 21:08:37 user devstack@n-api.service[61133]: X-User-Name: tempest-ServerActionsTestJSON-231415031-project-member Apr 18 21:08:37 user devstack@n-api.service[61133]: method: > Apr 18 21:08:37 user devstack@n-api.service[61133]: exception: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. Apr 18 21:08:37 user devstack@n-api.service[61133]: action_args: {'id': '335c54b1-9709-4d22-a947-49e98fbd72dd'} Apr 18 21:08:37 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. Apr 18 21:08:37 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:08:37 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Returning 404 to user: Instance 335c54b1-9709-4d22-a947-49e98fbd72dd could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:08:37 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-cc6e92f2-ba24-4ded-b539-2ad58815d11a tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd" status: 404 len: 111 microversion: 2.1 time: 0.044474 Apr 18 21:08:37 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 131/391] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:08:37 2023] GET /compute/v2.1/servers/335c54b1-9709-4d22-a947-49e98fbd72dd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:08:37 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:37 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=10 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:08:37 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-847e90cf-91db-434b-a5f3-45b5aa28e63e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] Calling method '.version_select at 0x7f51cffba560>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:08:37 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-847e90cf-91db-434b-a5f3-45b5aa28e63e tempest-ServerActionsTestJSON-231415031 tempest-ServerActionsTestJSON-231415031-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-784894121" status: 202 len: 0 microversion: 2.1 time: 0.025175 Apr 18 21:08:37 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 130/392] 10.0.0.210 () {62 vars in 1295 bytes} [Tue Apr 18 21:08:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-784894121 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=8 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=18 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:09:02 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe HTTP/1.1 Apr 18 21:09:02 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:09:02 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:09:02 user devstack@n-api.service[61135]: Connection: close Apr 18 21:09:02 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:09:02 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:09:02 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:09:02 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:09:02 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:02 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:09:02 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:09:02 user devstack@n-api.service[61135]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:09:02 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:02 user devstack@n-api.service[61135]: method: > Apr 18 21:09:02 user devstack@n-api.service[61135]: exception: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:02 user devstack@n-api.service[61135]: action_args: {'id': 'cde5fac0-7811-46d3-a441-40defca2aebe'} Apr 18 21:09:02 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-d32ae041-356c-4807-a976-cc55269102e4 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 404 len: 111 microversion: 2.1 time: 0.225090 Apr 18 21:09:02 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 132/393] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:02 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:02 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-2ddcae75-1d27-477c-8819-3ae5cbaa7b24 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '.version_select at 0x7f51cff99f30>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:02 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:02 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=2 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:02 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-2ddcae75-1d27-477c-8819-3ae5cbaa7b24 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059955912" status: 202 len: 0 microversion: 2.1 time: 0.025297 Apr 18 21:09:02 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 132/394] 10.0.0.210 () {62 vars in 1298 bytes} [Tue Apr 18 21:09:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1059955912 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:09:03 user devstack@n-api.service[61134]: request: DELETE /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe HTTP/1.1 Apr 18 21:09:03 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:09:03 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:09:03 user devstack@n-api.service[61134]: Connection: close Apr 18 21:09:03 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:09:03 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:09:03 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:09:03 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:09:03 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61134]: method: > Apr 18 21:09:03 user devstack@n-api.service[61134]: exception: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: action_args: {'id': 'cde5fac0-7811-46d3-a441-40defca2aebe'} Apr 18 21:09:03 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:03 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-c6239739-9398-402d-a09b-910246422e82 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 404 len: 111 microversion: 2.1 time: 0.034089 Apr 18 21:09:03 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 131/395] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:09:03 2023] DELETE /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: cde5fac0-7811-46d3-a441-40defca2aebe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:09:03 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe HTTP/1.1 Apr 18 21:09:03 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:09:03 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:09:03 user devstack@n-api.service[61135]: Connection: close Apr 18 21:09:03 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:09:03 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:09:03 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:09:03 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:09:03 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61135]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:09:03 user devstack@n-api.service[61135]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61135]: method: > Apr 18 21:09:03 user devstack@n-api.service[61135]: exception: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61135]: action_args: {'id': 'cde5fac0-7811-46d3-a441-40defca2aebe'} Apr 18 21:09:03 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. Apr 18 21:09:03 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance cde5fac0-7811-46d3-a441-40defca2aebe could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-351a0d78-ce04-4872-be6e-7a7875db4618 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe" status: 404 len: 111 microversion: 2.1 time: 0.030864 Apr 18 21:09:03 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 133/396] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:03 2023] GET /compute/v2.1/servers/cde5fac0-7811-46d3-a441-40defca2aebe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:09:03 user devstack@n-api.service[61133]: request: DELETE /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 HTTP/1.1 Apr 18 21:09:03 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:09:03 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:09:03 user devstack@n-api.service[61133]: Connection: close Apr 18 21:09:03 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:09:03 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:09:03 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:09:03 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:09:03 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61133]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:09:03 user devstack@n-api.service[61133]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61133]: method: > Apr 18 21:09:03 user devstack@n-api.service[61133]: exception: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61133]: action_args: {'id': '8550a1f5-306b-4396-bd98-7ccc4dd3b386'} Apr 18 21:09:03 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-4925dd1e-7abd-4061-9073-d57e831ce12a tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 404 len: 111 microversion: 2.1 time: 0.029513 Apr 18 21:09:03 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 133/397] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:09:03 2023] DELETE /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] [instance: 8550a1f5-306b-4396-bd98-7ccc4dd3b386] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:03 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] HTTP exception thrown: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Request method failure captured: Apr 18 21:09:03 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 HTTP/1.1 Apr 18 21:09:03 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:09:03 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:09:03 user devstack@n-api.service[61134]: Connection: close Apr 18 21:09:03 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:09:03 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:09:03 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:09:03 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:09:03 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwWh_VS7wzacJ1f5wCzAMmZJalQxUHBMz18pxze6BC4qe-XDKveDxCFVN6ZgHL0zlqvHyTkLfiAVyG7DS6o1ChXpD1kVuvXRbGJaIkxLaJQh_WQZn724dJUEs1b_O77PVVD9fqeT7hbvS8D2covD2LEJuHwE9IdZzTq9crfXV2WkNTo Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Project-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/4f87d615925045948bb95f84b990b2c5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant-Id: 4f87d615925045948bb95f84b990b2c5 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1434283235 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Id: 038d8b51fbcf4542a442e69729e90b52 Apr 18 21:09:03 user devstack@n-api.service[61134]: X-User-Name: tempest-AttachVolumeTestJSON-1434283235-project-member Apr 18 21:09:03 user devstack@n-api.service[61134]: method: > Apr 18 21:09:03 user devstack@n-api.service[61134]: exception: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: action_args: {'id': '8550a1f5-306b-4396-bd98-7ccc4dd3b386'} Apr 18 21:09:03 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. Apr 18 21:09:03 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:03 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] Returning 404 to user: Instance 8550a1f5-306b-4396-bd98-7ccc4dd3b386 could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:03 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-9cdae15d-c0d6-4ae7-8503-a5f525bbceb3 tempest-AttachVolumeTestJSON-1434283235 tempest-AttachVolumeTestJSON-1434283235-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386" status: 404 len: 111 microversion: 2.1 time: 0.028865 Apr 18 21:09:03 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 132/398] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:03 2023] GET /compute/v2.1/servers/8550a1f5-306b-4396-bd98-7ccc4dd3b386 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] HTTP exception thrown: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Request method failure captured: Apr 18 21:09:06 user devstack@n-api.service[61135]: request: DELETE /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb HTTP/1.1 Apr 18 21:09:06 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:09:06 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:09:06 user devstack@n-api.service[61135]: Connection: close Apr 18 21:09:06 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:09:06 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:09:06 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:09:06 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:09:06 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwTqhGO7H9wryvdCMwoJsxYRLk-sdKbGKN1V3YtshZsnZNLQWGgreU9HbqZB_OkuZA-BOsqzUogsvwejIaVO6Vjo_RlWjC4aGDIJ5yfOvsHpq2eNLZPx4xpuxuT2fn1rPq296p5Itb5s9ZEat1byyQA0kivZbIIJaRL3jSlZgjDDtmA Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Project-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Project-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e102abbb675645edbbd042f775e89e50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Tenant: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Tenant-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61135]: X-User: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:06 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:09:06 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:09:06 user devstack@n-api.service[61135]: X-User-Id: b36a393d92e948b1ada87c4823d14bee Apr 18 21:09:06 user devstack@n-api.service[61135]: X-User-Name: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:06 user devstack@n-api.service[61135]: method: > Apr 18 21:09:06 user devstack@n-api.service[61135]: exception: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61135]: action_args: {'id': '361eae1f-d5a7-434e-8946-82a0501644fb'} Apr 18 21:09:06 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Returning 404 to user: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-5738322e-0f09-480b-bcb6-af8ba2f9141b tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 404 len: 111 microversion: 2.1 time: 0.035683 Apr 18 21:09:06 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 134/399] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:09:06 2023] DELETE /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: 361eae1f-d5a7-434e-8946-82a0501644fb] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] HTTP exception thrown: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Request method failure captured: Apr 18 21:09:06 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb HTTP/1.1 Apr 18 21:09:06 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:09:06 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:09:06 user devstack@n-api.service[61133]: Connection: close Apr 18 21:09:06 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:09:06 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:09:06 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:09:06 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:09:06 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwTqhGO7H9wryvdCMwoJsxYRLk-sdKbGKN1V3YtshZsnZNLQWGgreU9HbqZB_OkuZA-BOsqzUogsvwejIaVO6Vjo_RlWjC4aGDIJ5yfOvsHpq2eNLZPx4xpuxuT2fn1rPq296p5Itb5s9ZEat1byyQA0kivZbIIJaRL3jSlZgjDDtmA Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Project-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Project-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e102abbb675645edbbd042f775e89e50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Tenant: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Tenant-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:06 user devstack@n-api.service[61133]: X-User: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:06 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:09:06 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:09:06 user devstack@n-api.service[61133]: X-User-Id: b36a393d92e948b1ada87c4823d14bee Apr 18 21:09:06 user devstack@n-api.service[61133]: X-User-Name: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:06 user devstack@n-api.service[61133]: method: > Apr 18 21:09:06 user devstack@n-api.service[61133]: exception: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61133]: action_args: {'id': '361eae1f-d5a7-434e-8946-82a0501644fb'} Apr 18 21:09:06 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. Apr 18 21:09:06 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Returning 404 to user: Instance 361eae1f-d5a7-434e-8946-82a0501644fb could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-c846c23f-9ca9-400e-aa2d-efb0d63daefb tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb" status: 404 len: 111 microversion: 2.1 time: 0.030951 Apr 18 21:09:06 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 134/400] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:06 2023] GET /compute/v2.1/servers/361eae1f-d5a7-434e-8946-82a0501644fb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:09:06 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-8680152d-1c05-4811-8bac-4268d5fe379c tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 204 len: 0 microversion: 2.1 time: 0.124569 Apr 18 21:09:06 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 133/401] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:09:06 2023] DELETE /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "name": "network-vif-unplugged", "status": "completed", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] Creating event network-vif-unplugged:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:09:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-4daf0318-17b3-45eb-880f-ad84b3c54d98 req-74b8435d-54b0-4f67-b753-d5155107f603 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034585 Apr 18 21:09:06 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 135/402] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:06 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b36a393d92e948b1ada87c4823d14bee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e102abbb675645edbbd042f775e89e50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-029f1873-a9c6-4105-aac9-f8d5639a0959 tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 200 len: 1500 microversion: 2.1 time: 0.473068 Apr 18 21:09:06 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 135/403] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:06 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 1500 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:08 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "name": "network-vif-plugged", "status": "completed", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}, {"server_uuid": "fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d", "name": "network-vif-deleted", "tag": "e8627bc3-9e15-45c6-a4f6-56a337459fd2"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Creating event network-vif-plugged:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:09:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] Creating event network-vif-deleted:e8627bc3-9e15-45c6-a4f6-56a337459fd2 for instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d on user Apr 18 21:09:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-d70560ea-8b5d-49e9-854f-5cd744e9e9ec req-e956f309-34ed-4f51-996d-59134693bea8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038281 Apr 18 21:09:08 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 134/404] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=8 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-f723f55b-1b65-4502-ae06-5e1426dfd99e tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Action: 'create', calling method: .version_select at 0x7f51cff99a20>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-1007989708", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFQ/75ZkGOGFs5Qo8BGVDVCLYFdq5/IDLpTrEXKScyltocKGd5SSYETyaPcz4/VI8P0A9mJ5Nd7O/OadtwojjKOfxxuN/njgFtw0jNItD9xxuY0nRnOrqEucRQPV8C+ZkQ=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-f723f55b-1b65-4502-ae06-5e1426dfd99e tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Getting quotas for project dfb6a7cd44d54b0ba412649c8bbf6994. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-f723f55b-1b65-4502-ae06-5e1426dfd99e tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Getting quotas for user 716420d635574ccaa1b646403117241e and project dfb6a7cd44d54b0ba412649c8bbf6994. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:09:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-f723f55b-1b65-4502-ae06-5e1426dfd99e tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.204947 Apr 18 21:09:16 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 136/405] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:09:16 2023] POST /compute/v2.1/os-keypairs => generated 405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:16 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:16 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-f84e50c0-e7d1-44be-8da1-1343a1109017 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 200 len: 1537 microversion: 2.1 time: 0.262704 Apr 18 21:09:16 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 136/406] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:16 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 1537 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Searching by: {'deleted': False, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe'} {{(pid=61134) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:16 user devstack@n-api.service[61134]: DEBUG nova.compute.multi_cell_list [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61134) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 21:09:16 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-cdb8c69b-5f7b-4a54-8edc-a872980ef3bf tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.201284 Apr 18 21:09:16 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 135/407] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 21:09:16 2023] GET /compute/v2.1/servers => generated 341 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=6 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:17 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:17 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-72ab43fd-a7f2-4892-a997-713b39917cfd tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 200 len: 1537 microversion: 2.1 time: 0.236591 Apr 18 21:09:17 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 137/408] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:16 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 1537 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:17 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-1216443373", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-1007989708", "security_groups": [{"name": "tempest-secgroup-smoke-330103830"}], "networks": [{"uuid": "7e521a80-8bb6-40e4-90b5-994f8140683b"}]}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:18 user devstack@n-api.service[61135]: DEBUG nova.network.neutron [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] validate_networks() for [('7e521a80-8bb6-40e4-90b5-994f8140683b', None, None, None, None, None)] {{(pid=61135) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:18 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:09:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-ff7f56f6-892c-435a-9790-9b0d33399b5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 204 len: 0 microversion: 2.1 time: 0.116321 Apr 18 21:09:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 136/409] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:09:18 2023] DELETE /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:18 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:19 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:19 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-94c0efd6-12bb-489c-bce9-82d2332711ac tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 200 len: 1543 microversion: 2.1 time: 0.219319 Apr 18 21:09:19 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 138/410] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:18 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 1543 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-unplugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] Creating event network-vif-unplugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:19 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-151baaa4-2ca9-43fb-beb0-cdfe58616517 req-897c9387-1f04-47b2-a1a6-1e32a5a4d7e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033635 Apr 18 21:09:19 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 137/411] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Flavor limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Image limits 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Flavor pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Image pref 0:0:0 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.virt.hardware [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61135) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Getting quotas for project dfb6a7cd44d54b0ba412649c8bbf6994. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Getting quotas for user 716420d635574ccaa1b646403117241e and project dfb6a7cd44d54b0ba412649c8bbf6994. Resources: {'cores', 'ram', 'instances'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Going to run 1 instances... {{(pid=61135) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:09:19 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61135) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:09:19 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-993dc192-31a3-4bbb-8fa3-143e83f034b6 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.497243 Apr 18 21:09:19 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 137/412] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:09:17 2023] POST /compute/v2.1/servers => generated 403 bytes in 1499 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 18 21:09:19 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-133791bc-4ddb-4e33-98e0-527ec1cb7b1c tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:19 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-133791bc-4ddb-4e33-98e0-527ec1cb7b1c tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:19 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-133791bc-4ddb-4e33-98e0-527ec1cb7b1c tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716420d635574ccaa1b646403117241e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb6a7cd44d54b0ba412649c8bbf6994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:19 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-133791bc-4ddb-4e33-98e0-527ec1cb7b1c tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 200 len: 1257 microversion: 2.1 time: 0.056257 Apr 18 21:09:19 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 139/413] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:19 2023] GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 1257 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1369868248", "imageRef": "2776403b-74df-489f-a4f5-d994ce6e9319", "flavorRef": "42", "networks": [{"uuid": "9a03f8ac-4964-4e76-b8ce-f2a36576da5d"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:19 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] validate_networks() for [('9a03f8ac-4964-4e76-b8ce-f2a36576da5d', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:09:21 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}, {"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}, {"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:21 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-bf6490b1-f3f8-4901-baf5-51037749c8ef req-8762bdfc-7415-401b-b4ab-599c1a136716 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.033331 Apr 18 21:09:21 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 138/414] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:21 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Getting quotas for project fb753655eb2547169eda59a72cc1bdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Getting quotas for user 34c55355fe5446d3bdc59df2454f0ee0 and project fb753655eb2547169eda59a72cc1bdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:09:21 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2776403b-74df-489f-a4f5-d994ce6e9319',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:09:21 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-33cbf612-2509-4911-a8d2-b75fed714338 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.805528 Apr 18 21:09:21 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 138/415] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:09:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:09:21 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-af4300ef-ba8e-429c-ab16-e6949588cfb6 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:21 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-af4300ef-ba8e-429c-ab16-e6949588cfb6 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:21 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-af4300ef-ba8e-429c-ab16-e6949588cfb6 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c55355fe5446d3bdc59df2454f0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb753655eb2547169eda59a72cc1bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:09:21 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-af4300ef-ba8e-429c-ab16-e6949588cfb6 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe" status: 200 len: 1208 microversion: 2.1 time: 0.065495 Apr 18 21:09:21 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 140/416] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:21 2023] GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe => generated 1208 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:09:23 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}, {"server_uuid": "3cd0b668-630c-459c-abf7-38089ca7ffb2", "name": "network-vif-deleted", "tag": "494aad1d-a5ef-41b1-952a-e604fb2e8eb3"}, {"name": "network-changed", "server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:23 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Creating event network-vif-plugged:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Creating event network-vif-deleted:494aad1d-a5ef-41b1-952a-e604fb2e8eb3 for instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 on user Apr 18 21:09:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] Creating event network-changed:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:09:23 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-952bf457-eed9-43cf-9bf2-75fc7b63b0cd req-3c4805e9-beb1-4022-9d05-77185318f06c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.038335 Apr 18 21:09:23 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 139/417] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:23 2023] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:25 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "name": "network-vif-plugged", "status": "completed", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:25 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] Creating event network-vif-plugged:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:09:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-0343bd4e-5151-4ee4-b7b0-34b465892f17 req-d7cc6044-da17-4e5e-b130-ee5d81164f20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034725 Apr 18 21:09:25 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 139/418] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:25 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:25 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] Creating event network-changed:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:09:25 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-27ab23e4-8a79-4384-8e99-cd2a65399219 req-92ef2aea-7c6f-44d8-b4e7-b4c709b23375 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032617 Apr 18 21:09:25 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 141/419] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:27 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "name": "network-vif-plugged", "status": "completed", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}, {"server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "name": "network-vif-plugged", "status": "completed", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}, {"server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "name": "network-vif-plugged", "status": "completed", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:09:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:27 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Creating event network-vif-plugged:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:09:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Creating event network-vif-plugged:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:09:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] Creating event network-vif-plugged:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:09:27 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-e0dbad60-6aa9-4b17-8467-b52c3f7cbe91 req-2135c08f-e449-42fe-9eff-b1912bc3f9ce service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.035090 Apr 18 21:09:27 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 140/420] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:09:27 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=4 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] [instance: fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:09:56 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] HTTP exception thrown: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Request method failure captured: Apr 18 21:09:56 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d HTTP/1.1 Apr 18 21:09:56 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:09:56 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:09:56 user devstack@n-api.service[61134]: Connection: close Apr 18 21:09:56 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:09:56 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:09:56 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:09:56 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:09:56 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwTqhGO7H9wryvdCMwoJsxYRLk-sdKbGKN1V3YtshZsnZNLQWGgreU9HbqZB_OkuZA-BOsqzUogsvwejIaVO6Vjo_RlWjC4aGDIJ5yfOvsHpq2eNLZPx4xpuxuT2fn1rPq296p5Itb5s9ZEat1byyQA0kivZbIIJaRL3jSlZgjDDtmA Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Project-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Project-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e102abbb675645edbbd042f775e89e50"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e102abbb675645edbbd042f775e89e50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Tenant: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Tenant-Id: e102abbb675645edbbd042f775e89e50 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1731515399 Apr 18 21:09:56 user devstack@n-api.service[61134]: X-User: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:56 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:09:56 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:09:56 user devstack@n-api.service[61134]: X-User-Id: b36a393d92e948b1ada87c4823d14bee Apr 18 21:09:56 user devstack@n-api.service[61134]: X-User-Name: tempest-ServersNegativeTestJSON-1731515399-project-member Apr 18 21:09:56 user devstack@n-api.service[61134]: method: > Apr 18 21:09:56 user devstack@n-api.service[61134]: exception: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. Apr 18 21:09:56 user devstack@n-api.service[61134]: action_args: {'id': 'fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d'} Apr 18 21:09:56 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. Apr 18 21:09:56 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:09:56 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] Returning 404 to user: Instance fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:09:56 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-5073a69c-1c95-4e63-9b34-7d0bd7b2c90d tempest-ServersNegativeTestJSON-1731515399 tempest-ServersNegativeTestJSON-1731515399-project-member] 10.0.0.210 "GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d" status: 404 len: 111 microversion: 2.1 time: 0.042812 Apr 18 21:09:56 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 140/421] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:09:56 2023] GET /compute/v2.1/servers/fcaf2c0d-aea9-4842-bc9c-0cc3ed6e313d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=8 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=14 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: 3cd0b668-630c-459c-abf7-38089ca7ffb2] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.wsgi [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] HTTP exception thrown: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Request method failure captured: Apr 18 21:10:09 user devstack@n-api.service[61133]: request: GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 HTTP/1.1 Apr 18 21:10:09 user devstack@n-api.service[61133]: Accept: application/json Apr 18 21:10:09 user devstack@n-api.service[61133]: Accept-Encoding: identity Apr 18 21:10:09 user devstack@n-api.service[61133]: Connection: close Apr 18 21:10:09 user devstack@n-api.service[61133]: Content-Length: 0 Apr 18 21:10:09 user devstack@n-api.service[61133]: Content-Type: application/json Apr 18 21:10:09 user devstack@n-api.service[61133]: Host: 10.0.0.210 Apr 18 21:10:09 user devstack@n-api.service[61133]: Openstack-System-Scope: None Apr 18 21:10:09 user devstack@n-api.service[61133]: User-Agent: python-urllib3/1.26.15 Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Auth-Token: gAAAAABkPwaEpNWT5C0ss8RN9RXGc7cDpSkkR7f5SRVEzGuUfVZHfcIUyiieJH9Zlrp3io2bents2ImpZqlWU6qgFpQ36boIqppXlz6PohUhzsTFRcShABlFxGDNo1v4h7kvQei-ZE-Hj8w215XIMTizv-KQ4wVgtTLOlyOEKZogvrk1rh2_9w4 Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Domain-Id: None Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Domain-Name: None Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Identity-Status: Confirmed Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Is-Admin-Project: True Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Project-Domain-Id: default Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Project-Domain-Name: Default Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Project-Id: 88559f8fa16b4a939cf83eddb216a4fe Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Project-Name: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Role: reader,member Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Roles: reader,member Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Tenant: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Tenant-Id: 88559f8fa16b4a939cf83eddb216a4fe Apr 18 21:10:09 user devstack@n-api.service[61133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:10:09 user devstack@n-api.service[61133]: X-User: tempest-TestMinimumBasicScenario-1842059004-project-member Apr 18 21:10:09 user devstack@n-api.service[61133]: X-User-Domain-Id: default Apr 18 21:10:09 user devstack@n-api.service[61133]: X-User-Domain-Name: Default Apr 18 21:10:09 user devstack@n-api.service[61133]: X-User-Id: 8c2d545b5459472990722072dcf2095c Apr 18 21:10:09 user devstack@n-api.service[61133]: X-User-Name: tempest-TestMinimumBasicScenario-1842059004-project-member Apr 18 21:10:09 user devstack@n-api.service[61133]: method: > Apr 18 21:10:09 user devstack@n-api.service[61133]: exception: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. Apr 18 21:10:09 user devstack@n-api.service[61133]: action_args: {'id': '3cd0b668-630c-459c-abf7-38089ca7ffb2'} Apr 18 21:10:09 user devstack@n-api.service[61133]: {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. Apr 18 21:10:09 user devstack@n-api.service[61133]: ERROR nova.api.openstack.wsgi Apr 18 21:10:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Returning 404 to user: Instance 3cd0b668-630c-459c-abf7-38089ca7ffb2 could not be found. {{(pid=61133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:10:09 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0537e2a7-10d8-4ddf-ae3f-bcc1e3a79e5b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2" status: 404 len: 111 microversion: 2.1 time: 0.041630 Apr 18 21:10:09 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 142/422] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:10:09 2023] GET /compute/v2.1/servers/3cd0b668-630c-459c-abf7-38089ca7ffb2 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:10:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=26 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-ffb3ac5c-5fbe-46c5-b2dc-75b7ebef206b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '.version_select at 0x7f51cfe5e710>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:09 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-ffb3ac5c-5fbe-46c5-b2dc-75b7ebef206b tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-624336600" status: 202 len: 0 microversion: 2.1 time: 0.030890 Apr 18 21:10:09 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 141/423] 10.0.0.210 () {62 vars in 1346 bytes} [Tue Apr 18 21:10:09 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-624336600 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:09 user devstack@n-api.service[61134]: DEBUG nova.policy [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716420d635574ccaa1b646403117241e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb6a7cd44d54b0ba412649c8bbf6994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61134) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:10:09 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-27c91f1b-d961-460d-ba22-4a70a3fb7928 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 200 len: 1568 microversion: 2.1 time: 0.341905 Apr 18 21:10:09 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 141/424] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:10:09 2023] GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 1568 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:11 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-9bc786c5-5133-4f09-afac-9b6249423648 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Action: 'create', calling method: .version_select at 0x7f51cfe9a320>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1690048903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI50Cb2+Tgl9v8MAbpcgw73CT4PHExVraf2TcEYOgGvjJaHUfa1duPjfeTpM140BFt7Vr0EdU74epRo7tjYCYyLpNqUycpyjncP8e8tYiFBf9mLcEgLHIvde+UA4QaIBpg=="}} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:11 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-9bc786c5-5133-4f09-afac-9b6249423648 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:10:11 user devstack@n-api.service[61135]: DEBUG nova.quota [None req-9bc786c5-5133-4f09-afac-9b6249423648 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for user 8c2d545b5459472990722072dcf2095c and project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'key_pairs'} {{(pid=61135) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:10:11 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-9bc786c5-5133-4f09-afac-9b6249423648 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.063553 Apr 18 21:10:11 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 142/425] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:10:11 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:10:11 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c55355fe5446d3bdc59df2454f0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb753655eb2547169eda59a72cc1bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:10:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1275240248", "imageRef": "cbd93b53-8c6f-421c-830c-ab4ff9bf0882", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1690048903", "networks": [{"uuid": "bbd69050-7c4f-467f-831b-bff2a5009ae5"}]}} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:11 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-999088fa-9171-425d-bcb3-50cd011d63a8 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe" status: 200 len: 1486 microversion: 2.1 time: 0.368127 Apr 18 21:10:11 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 143/426] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:10:11 2023] GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe => generated 1486 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:10:11 user devstack@n-api.service[61134]: DEBUG nova.network.neutron [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] validate_networks() for [('bbd69050-7c4f-467f-831b-bff2a5009ae5', None, None, None, None, None)] {{(pid=61134) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Flavor limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Image limits 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Flavor pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Image pref 0:0:0 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.virt.hardware [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.quota [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Getting quotas for user 8c2d545b5459472990722072dcf2095c and project 88559f8fa16b4a939cf83eddb216a4fe. Resources: {'cores', 'ram', 'instances'} {{(pid=61134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Going to run 1 instances... {{(pid=61134) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 18 21:10:13 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='cbd93b53-8c6f-421c-830c-ab4ff9bf0882',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 18 21:10:13 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-c407ebbc-ecfc-4a23-a8e4-4b74ae759ab7 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.328932 Apr 18 21:10:13 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 142/427] 10.0.0.210 () {64 vars in 1224 bytes} [Tue Apr 18 21:10:11 2023] POST /compute/v2.1/servers => generated 378 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 18 21:10:13 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-207f3b06-4bbe-473d-b793-dbdc3108b633 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:13 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-207f3b06-4bbe-473d-b793-dbdc3108b633 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:10:13 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-207f3b06-4bbe-473d-b793-dbdc3108b633 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:10:13 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-207f3b06-4bbe-473d-b793-dbdc3108b633 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 200 len: 1253 microversion: 2.1 time: 0.073010 Apr 18 21:10:13 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 143/428] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:10:13 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 1253 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:10:16 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:16 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] Creating event network-changed:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:10:16 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-69e890ab-e9b7-4bfa-9a65-447807bd83c3 req-5217e855-e61e-4a45-a1e1-4aad21926ad0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029575 Apr 18 21:10:16 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 144/429] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:10:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:10:18 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "name": "network-vif-plugged", "status": "completed", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:18 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] Creating event network-vif-plugged:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:10:18 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-87c6d82a-7475-4e8c-9cfd-9bb8cb87a61c req-659504da-b8d4-4910-8dbc-84e36fc250b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Apr 18 21:10:18 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 143/430] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:10:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:10:20 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "name": "network-vif-plugged", "status": "completed", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}]} {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:20 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:10:20 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:10:20 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:10:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.compute.server_external_events [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] Creating event network-vif-plugged:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:10:21 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [req-c3f4ab76-3b70-4bf6-a29c-9afc57767a20 req-cdcfa66f-b413-4b26-984f-1365083c7e87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032856 Apr 18 21:10:21 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 144/431] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:10:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:10:22 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0839c29f-07f6-4a4b-8777-1220b9533c17 tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] Action: 'create', calling method: .version_select at 0x7f51d42fb760>, body: {"keypair": {"name": "tempest-TestStampPattern-1755189974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEp5mO0t0bY1lqeh1HdPnuv9ruFLpjwe7clt4Tp5a5OGrpV9F64837zbGxSM0UBLvYQjSnEX6qijwudsGH4OXP7Pum+bc37Qjf93YaXZyRecO3QHdrrDLH0P/L+V4STu+g=="}} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:10:22 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-0839c29f-07f6-4a4b-8777-1220b9533c17 tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] Getting quotas for project 2099f48eb3074db59d421677f1745df3. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 18 21:10:22 user devstack@n-api.service[61133]: DEBUG nova.quota [None req-0839c29f-07f6-4a4b-8777-1220b9533c17 tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] Getting quotas for user 61b68a1ae8c44aaaa0bb97687752cbf3 and project 2099f48eb3074db59d421677f1745df3. Resources: {'key_pairs'} {{(pid=61133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 18 21:10:22 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0839c29f-07f6-4a4b-8777-1220b9533c17 tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.279600 Apr 18 21:10:22 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 145/432] 10.0.0.210 () {64 vars in 1236 bytes} [Tue Apr 18 21:10:22 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:10:25 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=2 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:25 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell0:SELECT=6 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:10:25 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-dd305dbd-7605-40b3-a0e9-b9566aede9ee tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] Calling method '.version_select at 0x7f51d421c280>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:10:25 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-dd305dbd-7605-40b3-a0e9-b9566aede9ee tempest-TestStampPattern-687436739 tempest-TestStampPattern-687436739-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1755189974" status: 202 len: 0 microversion: 2.1 time: 0.040400 Apr 18 21:10:25 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 144/433] 10.0.0.210 () {62 vars in 1325 bytes} [Tue Apr 18 21:10:25 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1755189974 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:03 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:11:03 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-643465c7-cf56-491d-809f-1438a0726643 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 200 len: 1537 microversion: 2.1 time: 0.255621 Apr 18 21:11:03 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 145/434] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:11:03 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 1537 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=10 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell0:SELECT=4 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:09 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:10 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716420d635574ccaa1b646403117241e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb6a7cd44d54b0ba412649c8bbf6994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:11:10 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-08e83f40-1968-41fb-82ae-076e0d0b7155 tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 200 len: 1568 microversion: 2.1 time: 0.253182 Apr 18 21:11:10 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 146/435] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:11:09 2023] GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=10 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:11 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:11:11 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-9fa21df3-ef64-4596-84c7-56dcd10aa06f tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 204 len: 0 microversion: 2.1 time: 0.135801 Apr 18 21:11:11 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 145/436] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:11:11 2023] DELETE /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:11 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:12 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "name": "network-vif-unplugged", "status": "completed", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:11:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:12 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] Creating event network-vif-unplugged:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:11:12 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-1c36ebd4-cfe4-43b6-b1b5-fa286e36492e req-7fd4c00a-a24a-4a63-b5bd-dfada52ea6ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030013 Apr 18 21:11:12 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 147/437] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:11:12 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '716420d635574ccaa1b646403117241e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfb6a7cd44d54b0ba412649c8bbf6994', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:11:12 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-0cb046d6-625c-47e1-84d3-bbcb1ec70c4b tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 200 len: 1574 microversion: 2.1 time: 0.528335 Apr 18 21:11:12 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 146/438] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:11:11 2023] GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 1574 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:11:12 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "name": "network-vif-deleted", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:11:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:13 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:13 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] Creating event network-vif-deleted:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:11:13 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-f712d2ca-5275-47b1-be2a-f394533e146a req-97a7ba9d-6431-4a50-ada8-aef19f2bfff0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030921 Apr 18 21:11:13 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 146/439] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:11:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:13 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Going to try to terminate instance {{(pid=61133) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:11:13 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-0c0e48a7-2b98-4133-9e82-414d90db7a6b tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe" status: 204 len: 0 microversion: 2.1 time: 0.144361 Apr 18 21:11:13 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 148/440] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:11:13 2023] DELETE /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:13 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:14 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34c55355fe5446d3bdc59df2454f0ee0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb753655eb2547169eda59a72cc1bdbf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:11:14 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-b1a8d0af-f5d8-4a8c-86b0-c18c49869bd1 tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe" status: 200 len: 1492 microversion: 2.1 time: 0.343613 Apr 18 21:11:14 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 147/441] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:11:13 2023] GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe => generated 1492 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:11:14 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddddb36-e55d-4e94-9475-98f2d18f4b53", "name": "network-vif-plugged", "status": "completed", "tag": "d2704864-588e-480b-93e9-ef3b833f65ae"}, {"server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "name": "network-vif-unplugged", "status": "completed", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}, {"server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "name": "network-vif-plugged", "status": "completed", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:11:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:14 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Creating event network-vif-plugged:d2704864-588e-480b-93e9-ef3b833f65ae for instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 on user Apr 18 21:11:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Creating event network-vif-unplugged:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:11:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] Creating event network-vif-plugged:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:11:14 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-e7a9252c-71e6-441c-8145-bae4a811416a req-e73af83a-b93a-455e-998c-a8664bd9d5c1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.034399 Apr 18 21:11:14 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 147/442] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:11:14 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:11:15 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6285c504-c591-4a6b-a9bc-686d858b33fe", "name": "network-vif-deleted", "tag": "33666b62-3d4e-4b8e-9b27-fe7d85d249ff"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:11:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:11:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:11:15 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:11:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] Creating event network-vif-deleted:33666b62-3d4e-4b8e-9b27-fe7d85d249ff for instance 6285c504-c591-4a6b-a9bc-686d858b33fe on user Apr 18 21:11:15 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-de00cfe2-4863-49db-9e11-6d95e0bcffd0 req-6bce2d03-be82-4959-9406-3cba36c57841 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027171 Apr 18 21:11:15 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 149/443] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:11:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] [instance: 3ddddb36-e55d-4e94-9475-98f2d18f4b53] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:02 user devstack@n-api.service[61135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:02 user devstack@n-api.service[61135]: Tue Apr 18 21:12:02 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 (ip 10.0.0.210) !!! Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=18 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] HTTP exception thrown: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Request method failure captured: Apr 18 21:12:02 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 HTTP/1.1 Apr 18 21:12:02 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:12:02 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:12:02 user devstack@n-api.service[61135]: Connection: close Apr 18 21:12:02 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:12:02 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:12:02 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:12:02 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:12:02 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwb0AOAc_S_aMxws2qGphMiFc825zPvuTF5mgP3Smc92ep8De63C0sDBVBlOt-8y7d8v27rdF25fep--ePH941lBioXHJyE5JjLsx2JpoTIi5ijHh8lTFn0ia-hy1w7bB43GzTB5h6kIPhMBPFa7ei1yIiYruOEgnyi-JnPLQX6-jdY Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Project-Id: dfb6a7cd44d54b0ba412649c8bbf6994 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Project-Name: tempest-SnapshotDataIntegrityTests-506713742 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dfb6a7cd44d54b0ba412649c8bbf6994"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dfb6a7cd44d54b0ba412649c8bbf6994"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dfb6a7cd44d54b0ba412649c8bbf6994"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Tenant: tempest-SnapshotDataIntegrityTests-506713742 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Tenant-Id: dfb6a7cd44d54b0ba412649c8bbf6994 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-506713742 Apr 18 21:12:02 user devstack@n-api.service[61135]: X-User: tempest-SnapshotDataIntegrityTests-506713742-project-member Apr 18 21:12:02 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:12:02 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:12:02 user devstack@n-api.service[61135]: X-User-Id: 716420d635574ccaa1b646403117241e Apr 18 21:12:02 user devstack@n-api.service[61135]: X-User-Name: tempest-SnapshotDataIntegrityTests-506713742-project-member Apr 18 21:12:02 user devstack@n-api.service[61135]: method: > Apr 18 21:12:02 user devstack@n-api.service[61135]: exception: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. Apr 18 21:12:02 user devstack@n-api.service[61135]: action_args: {'id': '3ddddb36-e55d-4e94-9475-98f2d18f4b53'} Apr 18 21:12:02 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. Apr 18 21:12:02 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:02 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Returning 404 to user: Instance 3ddddb36-e55d-4e94-9475-98f2d18f4b53 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:12:02 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-3cdce3e8-ce81-45dd-b3d7-96a26147d94a tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53" status: 404 len: 111 microversion: 2.1 time: 0.041768 Apr 18 21:12:02 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 148/444] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:02 2023] GET /compute/v2.1/servers/3ddddb36-e55d-4e94-9475-98f2d18f4b53 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:12:02 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:02 user devstack@n-api.service[61134]: DEBUG dbcounter [-] [61134] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61134) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:02 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-6a082bf5-2a5a-4d95-a72c-9f057e2939ff tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] Calling method '.version_select at 0x7f51cfe19b40>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:02 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-6a082bf5-2a5a-4d95-a72c-9f057e2939ff tempest-SnapshotDataIntegrityTests-506713742 tempest-SnapshotDataIntegrityTests-506713742-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1007989708" status: 202 len: 0 microversion: 2.1 time: 0.037789 Apr 18 21:12:02 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 148/445] 10.0.0.210 () {62 vars in 1355 bytes} [Tue Apr 18 21:12:02 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-1007989708 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:03 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:12:03 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-b970e0e7-7953-4bc2-8357-c9b7f43174c5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 200 len: 1537 microversion: 2.1 time: 0.246314 Apr 18 21:12:03 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 150/446] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:03 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 1537 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Searching by: {'deleted': False, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe'} {{(pid=61135) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:03 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:04 user devstack@n-api.service[61135]: DEBUG nova.compute.multi_cell_list [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61135) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] [instance: 6285c504-c591-4a6b-a9bc-686d858b33fe] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.wsgi [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] HTTP exception thrown: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Request method failure captured: Apr 18 21:12:04 user devstack@n-api.service[61134]: request: GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe HTTP/1.1 Apr 18 21:12:04 user devstack@n-api.service[61134]: Accept: application/json Apr 18 21:12:04 user devstack@n-api.service[61134]: Accept-Encoding: identity Apr 18 21:12:04 user devstack@n-api.service[61134]: Connection: close Apr 18 21:12:04 user devstack@n-api.service[61134]: Content-Length: 0 Apr 18 21:12:04 user devstack@n-api.service[61134]: Content-Type: application/json Apr 18 21:12:04 user devstack@n-api.service[61134]: Host: 10.0.0.210 Apr 18 21:12:04 user devstack@n-api.service[61134]: Openstack-System-Scope: None Apr 18 21:12:04 user devstack@n-api.service[61134]: User-Agent: python-urllib3/1.26.15 Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Auth-Token: gAAAAABkPwb97TXeshNr19mIznrZ1zjrClxldwe9lINfETsDxlsfEkZLdDaxBBvJzJSzMsQMhdNLQANXFLOQWc2PxNn8Rx6YXifIb2OfqEA2uzt7GaltfLgSJeyN6xJ6100pkTYEPTcFtFTfe2_82JhKh9OLkb5R1YveUmkCv_HEVuBxgfNlVnw Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Domain-Id: None Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Domain-Name: None Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Identity-Status: Confirmed Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Is-Admin-Project: True Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Project-Domain-Id: default Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Project-Domain-Name: Default Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Project-Id: fb753655eb2547169eda59a72cc1bdbf Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Project-Name: tempest-VolumesActionsTest-431839314 Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Role: reader,member Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Roles: reader,member Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fb753655eb2547169eda59a72cc1bdbf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/fb753655eb2547169eda59a72cc1bdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/fb753655eb2547169eda59a72cc1bdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Tenant: tempest-VolumesActionsTest-431839314 Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Tenant-Id: fb753655eb2547169eda59a72cc1bdbf Apr 18 21:12:04 user devstack@n-api.service[61134]: X-Tenant-Name: tempest-VolumesActionsTest-431839314 Apr 18 21:12:04 user devstack@n-api.service[61134]: X-User: tempest-VolumesActionsTest-431839314-project-member Apr 18 21:12:04 user devstack@n-api.service[61134]: X-User-Domain-Id: default Apr 18 21:12:04 user devstack@n-api.service[61134]: X-User-Domain-Name: Default Apr 18 21:12:04 user devstack@n-api.service[61134]: X-User-Id: 34c55355fe5446d3bdc59df2454f0ee0 Apr 18 21:12:04 user devstack@n-api.service[61134]: X-User-Name: tempest-VolumesActionsTest-431839314-project-member Apr 18 21:12:04 user devstack@n-api.service[61134]: method: > Apr 18 21:12:04 user devstack@n-api.service[61134]: exception: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. Apr 18 21:12:04 user devstack@n-api.service[61134]: action_args: {'id': '6285c504-c591-4a6b-a9bc-686d858b33fe'} Apr 18 21:12:04 user devstack@n-api.service[61134]: {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. Apr 18 21:12:04 user devstack@n-api.service[61134]: ERROR nova.api.openstack.wsgi Apr 18 21:12:04 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] Returning 404 to user: Instance 6285c504-c591-4a6b-a9bc-686d858b33fe could not be found. {{(pid=61134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:12:04 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-00e7c69f-9bbb-45a3-96a1-707edcf6be2e tempest-VolumesActionsTest-431839314 tempest-VolumesActionsTest-431839314-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe" status: 404 len: 111 microversion: 2.1 time: 0.031096 Apr 18 21:12:04 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 149/447] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:04 2023] GET /compute/v2.1/servers/6285c504-c591-4a6b-a9bc-686d858b33fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:12:04 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-849c59b5-ca3a-4c32-b6e1-0ab606f23eb5 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.225113 Apr 18 21:12:04 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 149/448] 10.0.0.210 () {62 vars in 1202 bytes} [Tue Apr 18 21:12:03 2023] GET /compute/v2.1/servers => generated 341 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG nova.compute.api [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61133) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:04 user devstack@n-api.service[61133]: DEBUG nova.policy [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61133) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:12:04 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-5f1084f7-e6a1-453d-92e0-ce99016f4759 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 200 len: 1537 microversion: 2.1 time: 0.231815 Apr 18 21:12:04 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 151/449] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:04 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 1537 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61134) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:05 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:06 user devstack@n-api.service[61134]: DEBUG nova.compute.api [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Going to try to terminate instance {{(pid=61134) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 18 21:12:06 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [None req-17cf33db-9428-4635-bf9b-d96d49c59e06 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 204 len: 0 microversion: 2.1 time: 0.118184 Apr 18 21:12:06 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 150/450] 10.0.0.210 () {62 vars in 1316 bytes} [Tue Apr 18 21:12:05 2023] DELETE /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:06 user devstack@n-api.service[61135]: DEBUG nova.policy [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8c2d545b5459472990722072dcf2095c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88559f8fa16b4a939cf83eddb216a4fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61135) authorize /opt/stack/nova/nova/policy.py:203}} Apr 18 21:12:06 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-3d1bc964-c15c-4ffe-b312-3236df60ee25 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 200 len: 1543 microversion: 2.1 time: 0.295348 Apr 18 21:12:06 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 150/451] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:06 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 1543 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 18 21:12:06 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}]} {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:12:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:06 user devstack@n-api.service[61133]: DEBUG oslo_concurrency.lockutils [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61133) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.compute.server_external_events [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] Creating event network-vif-unplugged:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:12:06 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [req-bb4decee-f397-4c2a-b35a-beaf99bf9ed9 req-c2c1d840-1ae5-4d3a-9193-d9ae205cbc25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029329 Apr 18 21:12:06 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 152/452] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:12:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:12:08 user devstack@n-api.service[61134]: DEBUG nova.api.openstack.wsgi [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "name": "network-vif-plugged", "status": "completed", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}, {"server_uuid": "b43dfa4e-a63e-40e1-aa91-113d41b56856", "name": "network-vif-deleted", "tag": "6f4683ec-e0f5-40b0-b963-3f1af9158662"}]} {{(pid=61134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 18 21:12:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:08 user devstack@n-api.service[61134]: DEBUG oslo_concurrency.lockutils [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61134) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Creating event network-vif-plugged:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:12:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.compute.server_external_events [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] Creating event network-vif-deleted:6f4683ec-e0f5-40b0-b963-3f1af9158662 for instance b43dfa4e-a63e-40e1-aa91-113d41b56856 on user Apr 18 21:12:08 user devstack@n-api.service[61134]: INFO nova.api.openstack.requestlog [req-5731bc02-a64b-40f7-b40a-c081d9c0dc11 req-99d8ab8e-2bb5-4279-b5ef-38668ea82187 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.028546 Apr 18 21:12:08 user devstack@n-api.service[61134]: [pid: 61134|app: 0|req: 151/453] 10.0.0.210 () {68 vars in 1394 bytes} [Tue Apr 18 21:12:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell0:SELECT=2 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_api:SELECT=6 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG dbcounter [-] [61135] Writing DB stats nova_cell1:SELECT=16 {{(pid=61135) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:56 user devstack@n-api.service[61135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:56 user devstack@n-api.service[61135]: Tue Apr 18 21:12:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 (ip 10.0.0.210) !!! Apr 18 21:12:56 user devstack@n-api.service[61135]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:56 user devstack@n-api.service[61135]: Tue Apr 18 21:12:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 (ip 10.0.0.210) !!! Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '>' {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG nova.compute.api [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] [instance: b43dfa4e-a63e-40e1-aa91-113d41b56856] Fetching instance by UUID {{(pid=61135) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Acquiring lock "88560d0d-7818-4020-888f-ef6d4621691d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG oslo_concurrency.lockutils [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Lock "88560d0d-7818-4020-888f-ef6d4621691d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61135) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 18 21:12:56 user devstack@n-api.service[61135]: INFO nova.api.openstack.wsgi [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] HTTP exception thrown: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Request method failure captured: Apr 18 21:12:56 user devstack@n-api.service[61135]: request: GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 HTTP/1.1 Apr 18 21:12:56 user devstack@n-api.service[61135]: Accept: application/json Apr 18 21:12:56 user devstack@n-api.service[61135]: Accept-Encoding: identity Apr 18 21:12:56 user devstack@n-api.service[61135]: Connection: close Apr 18 21:12:56 user devstack@n-api.service[61135]: Content-Length: 0 Apr 18 21:12:56 user devstack@n-api.service[61135]: Content-Type: application/json Apr 18 21:12:56 user devstack@n-api.service[61135]: Host: 10.0.0.210 Apr 18 21:12:56 user devstack@n-api.service[61135]: Openstack-System-Scope: None Apr 18 21:12:56 user devstack@n-api.service[61135]: User-Agent: python-urllib3/1.26.15 Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Auth-Token: gAAAAABkPwaEpNWT5C0ss8RN9RXGc7cDpSkkR7f5SRVEzGuUfVZHfcIUyiieJH9Zlrp3io2bents2ImpZqlWU6qgFpQ36boIqppXlz6PohUhzsTFRcShABlFxGDNo1v4h7kvQei-ZE-Hj8w215XIMTizv-KQ4wVgtTLOlyOEKZogvrk1rh2_9w4 Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Domain-Id: None Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Domain-Name: None Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Identity-Status: Confirmed Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Is-Admin-Project: True Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Project-Domain-Id: default Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Project-Domain-Name: Default Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Project-Id: 88559f8fa16b4a939cf83eddb216a4fe Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Project-Name: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Role: reader,member Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Roles: reader,member Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/88559f8fa16b4a939cf83eddb216a4fe"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}] Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Tenant: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Tenant-Id: 88559f8fa16b4a939cf83eddb216a4fe Apr 18 21:12:56 user devstack@n-api.service[61135]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1842059004 Apr 18 21:12:56 user devstack@n-api.service[61135]: X-User: tempest-TestMinimumBasicScenario-1842059004-project-member Apr 18 21:12:56 user devstack@n-api.service[61135]: X-User-Domain-Id: default Apr 18 21:12:56 user devstack@n-api.service[61135]: X-User-Domain-Name: Default Apr 18 21:12:56 user devstack@n-api.service[61135]: X-User-Id: 8c2d545b5459472990722072dcf2095c Apr 18 21:12:56 user devstack@n-api.service[61135]: X-User-Name: tempest-TestMinimumBasicScenario-1842059004-project-member Apr 18 21:12:56 user devstack@n-api.service[61135]: method: > Apr 18 21:12:56 user devstack@n-api.service[61135]: exception: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. Apr 18 21:12:56 user devstack@n-api.service[61135]: action_args: {'id': 'b43dfa4e-a63e-40e1-aa91-113d41b56856'} Apr 18 21:12:56 user devstack@n-api.service[61135]: {{(pid=61135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. Apr 18 21:12:56 user devstack@n-api.service[61135]: ERROR nova.api.openstack.wsgi Apr 18 21:12:56 user devstack@n-api.service[61135]: DEBUG nova.api.openstack.wsgi [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Returning 404 to user: Instance b43dfa4e-a63e-40e1-aa91-113d41b56856 could not be found. {{(pid=61135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 18 21:12:56 user devstack@n-api.service[61135]: INFO nova.api.openstack.requestlog [None req-1d4e8cc4-4fd5-4e47-a0b4-1c9ac6286d1a tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856" status: 404 len: 111 microversion: 2.1 time: 0.253069 Apr 18 21:12:56 user devstack@n-api.service[61135]: [pid: 61135|app: 0|req: 151/454] 10.0.0.210 () {62 vars in 1313 bytes} [Tue Apr 18 21:12:56 2023] GET /compute/v2.1/servers/b43dfa4e-a63e-40e1-aa91-113d41b56856 => generated 111 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 18 21:12:56 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_api:SELECT=6 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:56 user devstack@n-api.service[61133]: DEBUG dbcounter [-] [61133] Writing DB stats nova_cell1:SELECT=14 {{(pid=61133) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 18 21:12:56 user devstack@n-api.service[61133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:56 user devstack@n-api.service[61133]: Tue Apr 18 21:12:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1690048903 (ip 10.0.0.210) !!! Apr 18 21:12:56 user devstack@n-api.service[61133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 18 21:12:56 user devstack@n-api.service[61133]: Tue Apr 18 21:12:56 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1690048903 (ip 10.0.0.210) !!! Apr 18 21:12:56 user devstack@n-api.service[61133]: DEBUG nova.api.openstack.wsgi [None req-6fa4b9c7-995e-4565-b6d0-e5a02035a636 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] Calling method '.version_select at 0x7f51cff992d0>' {{(pid=61133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 18 21:12:56 user devstack@n-api.service[61133]: INFO nova.api.openstack.requestlog [None req-6fa4b9c7-995e-4565-b6d0-e5a02035a636 tempest-TestMinimumBasicScenario-1842059004 tempest-TestMinimumBasicScenario-1842059004-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1690048903" status: 202 len: 0 microversion: 2.1 time: 0.037259 Apr 18 21:12:56 user devstack@n-api.service[61133]: [pid: 61133|app: 0|req: 153/455] 10.0.0.210 () {62 vars in 1349 bytes} [Tue Apr 18 21:12:56 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1690048903 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)